-- Logs begin at Wed 2021-12-15 15:30:43 UTC, end at Wed 2021-12-15 16:29:55 UTC. -- Dec 15 16:02:24.829321 dv-cinder-800704-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:02:24.839865 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:02:24 2021] *** Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: nodename: dv-cinder-800704-2-iscsi Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: machine: x86_64 Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: clock source: unix Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: pcre jit disabled Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: detected number of CPU cores: 4 Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: current working directory: / Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: your processes number limit is 47680 Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: your memory page size is 4096 bytes Dec 15 16:02:24.843188 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: detected max file descriptor number: 2048 Dec 15 16:02:24.844109 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: lock engine: pthread robust mutexes Dec 15 16:02:24.844109 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: thunder lock: enabled Dec 15 16:02:24.844109 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:02:24.844109 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:02:24.887217 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: Python main interpreter initialized at 0x5581311d99c0 Dec 15 16:02:24.887217 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: python threads support enabled Dec 15 16:02:24.887217 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: your server socket listen backlog is limited to 100 connections Dec 15 16:02:24.887217 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:02:24.887545 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:02:24.887610 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: *** Operational MODE: preforking *** Dec 15 16:02:24.887875 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:02:24.887875 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: spawned uWSGI master process (pid: 101864) Dec 15 16:02:24.888076 dv-cinder-800704-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:02:24.888573 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: spawned uWSGI worker 1 (pid: 101865, cores: 1) Dec 15 16:02:24.888881 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: spawned uWSGI worker 2 (pid: 101866, cores: 1) Dec 15 16:02:24.889045 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:02:26.611591 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:02:26.611591 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: from cryptography.utils import int_from_bytes Dec 15 16:02:26.612269 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:02:26.612269 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: from cryptography.utils import int_from_bytes Dec 15 16:02:26.615653 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:02:26.615653 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: from cryptography.utils import int_from_bytes Dec 15 16:02:26.616162 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:02:26.616162 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: from cryptography.utils import int_from_bytes Dec 15 16:02:29.185800 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:02:29.186436 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:02:29.186594 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:02:29.186738 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:02:29.187148 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:02:29.187239 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:02:29.187335 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:02:29.187469 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:02:29.187573 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.187830 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:02:29.187921 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.188086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:02:29.188185 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.188477 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.188579 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.188799 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.188892 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.189108 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.189204 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.189444 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.189535 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.189761 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.189848 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190078 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190169 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190332 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190424 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190643 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190739 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.190965 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800704-2-iscsi {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191053 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191259 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191350 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191573 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191673 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191881 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.191968 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800704-2-iscsi {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.192196 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.192283 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.192500 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.192601 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.192806 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.192904 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.193106 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.193198 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.193431 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.193641 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.193747 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.194765 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.194913 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.194913 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195113 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195206 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195286 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195413 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195505 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195598 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195678 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195783 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195864 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.195993 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196166 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196359 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196466 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196674 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196761 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.196982 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.197153 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800704-2-iscsi {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.197306 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.197491 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.197649 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.197805 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198045 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800704-2-iscsi {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198138 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198361 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198527 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198677 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198824 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.198980 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.199132 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.199390 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.199505 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.199702 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.199806 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200015 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200121 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200332 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200420 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200685 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200844 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.200989 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.201203 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.201335 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.201452 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.201637 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.201744 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.201956 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202052 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202267 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202353 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202571 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202696 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202874 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.202976 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.203175 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.203272 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.203423 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.203532 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.203728 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.203824 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204047 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204143 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204308 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204411 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204615 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204717 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.204905 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205000 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205154 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205258 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205489 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205582 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205820 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.205926 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206054 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206141 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206374 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206472 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206694 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206804 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.206998 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.207084 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.207302 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.207388 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.207603 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.207704 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.207906 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208011 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208208 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208300 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208515 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208609 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208822 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.208917 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.209127 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.209213 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.209448 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.209537 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.209765 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.209852 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.210082 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.210169 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.210390 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.210482 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.210696 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.210788 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211031 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211126 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211324 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211410 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211632 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211721 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.211944 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212045 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212261 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212348 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212565 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212657 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212867 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.212966 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.213170 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.213256 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.213507 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.213609 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.213816 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.213917 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214125 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214212 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214369 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214455 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214666 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214753 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.214967 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215059 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215281 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215374 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215581 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215680 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215880 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.215965 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.216206 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.216313 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.216573 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.216747 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.216878 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.217145 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.217230 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.217472 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.217575 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.217777 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.217863 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218080 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218174 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218383 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218477 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218686 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218771 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.218990 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219079 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219292 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219395 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219599 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219694 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219905 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.219991 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.220207 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.220300 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.220509 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.220595 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.220813 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.220907 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.221116 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.221203 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.221446 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.221546 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.221751 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.221836 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222054 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222146 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222361 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222458 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222664 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222749 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.222967 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223062 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223272 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223357 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223575 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223660 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223881 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.223974 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.224185 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.224270 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.224480 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.224566 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.224785 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.224872 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.225090 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.225175 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.225423 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.225513 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.225713 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.225801 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226015 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226100 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226318 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226429 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226626 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226762 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.226920 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227014 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227217 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227311 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227515 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227603 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227812 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.227899 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.228114 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.228207 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.228418 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.228514 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.228720 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.228805 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229018 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229110 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229319 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229431 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229657 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229757 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.229963 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.230050 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.230271 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.230364 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.230577 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.230663 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.230893 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:02:29.230988 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.231230 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.231317 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.231551 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.231655 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.232456 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.232560 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.232758 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.232855 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.233071 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.233168 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.233410 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.233502 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.233727 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.233813 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234038 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234143 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234348 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234447 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234664 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234750 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.234975 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.235068 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.235286 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.235372 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.235599 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.235685 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.235911 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236020 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236225 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236311 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236533 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236622 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236849 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.236952 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.237164 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.237253 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.237509 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.237600 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.237818 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.237917 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.238135 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.238221 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.238461 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.238556 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.238776 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.238874 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.239086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.239171 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.239396 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.239486 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.239717 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.239805 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240029 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240115 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240339 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240425 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240650 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240744 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.240969 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.241054 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.241279 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.241364 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.241613 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.241704 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.241925 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242012 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242246 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242331 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242558 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242656 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242860 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.242953 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.243162 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.243257 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.243466 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.243558 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.243773 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.243859 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244075 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244173 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244385 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244470 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244690 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244786 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.244996 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.245090 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.245298 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.245414 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.245640 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.245736 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.245951 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246119 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246255 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246341 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246555 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246646 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246867 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.246955 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.247176 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.247263 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248099 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248249 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248366 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248455 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248681 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248796 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.248994 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.249113 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.249303 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.249461 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.249651 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.249770 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.249965 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250075 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250272 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250388 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250595 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250691 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250899 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.250995 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.251204 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.251297 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.251516 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.251610 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.251827 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.251922 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.252136 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.252223 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.252447 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.252533 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.252769 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.252864 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.253082 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.253176 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.253441 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.253533 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.253755 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.253854 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254071 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254158 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254375 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254463 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254688 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254776 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.254993 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.255086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.255299 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.255385 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.255605 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.255691 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.255913 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256004 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256217 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256310 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256520 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256607 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256824 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.256918 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.257129 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.257218 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.257455 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.257552 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.257761 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.257859 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258068 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258168 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258368 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258453 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258670 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258757 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.258972 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259070 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259288 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259379 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259592 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259678 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259896 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.259991 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.260201 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.260295 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.260545 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.260673 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.260852 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.260972 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.261160 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.261246 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.261503 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.261598 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.261813 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.261908 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.262123 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.262209 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.262433 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.262519 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.262741 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.262837 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.263078 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.263176 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.263400 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.263493 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.263720 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.263806 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264033 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264154 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264350 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264458 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264657 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264755 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.264973 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.265071 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.265275 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.265381 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.265615 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.265714 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.265923 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266020 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266244 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266355 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266551 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266648 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266868 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.266965 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.267175 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.267299 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.267490 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.267590 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.267799 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.267896 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.268108 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.268218 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.268418 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.268515 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.268725 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.268822 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269033 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269142 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269339 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269520 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269676 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269762 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.269984 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.270073 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.270299 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.270384 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.270604 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.270690 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.270922 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271009 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271226 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271313 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271538 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271631 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271846 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.271939 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.272165 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.272251 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.272470 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.272556 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.272780 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.272866 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.273098 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.273184 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.273426 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.273547 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.273738 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.273845 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274049 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274145 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274352 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274461 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274655 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274754 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.274962 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275057 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275272 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275443 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275577 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275675 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275881 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.275966 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.276183 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.276279 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.276494 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.276581 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.276807 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.276900 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.277107 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.277204 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.277426 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.277519 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.277736 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.277832 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.278043 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.278132 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.278347 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.278435 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.278652 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.279308 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.279487 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.279634 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.279786 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.279992 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.280087 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.280327 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.280425 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.280654 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.280743 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.280955 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.281041 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.281533 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.281637 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.281839 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.281934 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.282170 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.282256 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.282478 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.282571 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.282781 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.282869 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.283086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.283171 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.283393 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.283481 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.283699 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.283792 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284012 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284100 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284321 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284409 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284629 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284723 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.284946 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.285032 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.285254 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.285348 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.285583 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.285670 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.285894 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286001 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286201 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286288 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286509 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286596 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286819 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.286928 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.287128 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.287223 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.287439 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.287526 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.287746 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.287844 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288054 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288143 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288355 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288442 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288664 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288763 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.288973 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.289060 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.289287 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.289560 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.289711 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.289898 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.289994 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.290215 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.290301 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.290532 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.290626 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.290851 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.291098 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.291186 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.291436 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.291523 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.291801 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.291896 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.292082 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.292172 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.292388 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.292483 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.292698 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.292786 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293003 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293091 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293307 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293419 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293649 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293737 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.293955 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.294053 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.294261 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.294432 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.294726 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.294885 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295040 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295153 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295329 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295429 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295631 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295719 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.295965 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296059 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296267 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296368 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296579 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296667 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296880 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.296966 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.297184 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.297270 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.297513 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.297618 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.297838 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.297943 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.298143 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.298231 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.298447 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.298546 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.298748 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.298835 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299050 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299137 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299370 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299469 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299679 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299766 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.299983 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.300077 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.300289 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.300380 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.300594 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.300683 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.300937 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301026 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301237 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301325 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301582 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301682 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301885 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.301973 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.302187 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.302276 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.302488 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.302575 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.302797 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.302896 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.303103 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.303190 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.303404 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.303492 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.303716 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.303813 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304016 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304103 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304321 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304409 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304628 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304725 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.304929 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305023 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305239 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305326 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305576 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305678 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305888 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.305976 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.306194 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.306281 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.306494 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.306581 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.306791 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.306884 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.307094 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.307182 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.307406 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.307497 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.307707 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.307798 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308008 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308104 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308306 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308395 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308615 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308705 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.308915 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.309003 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.309217 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.309306 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.309541 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.309643 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.309846 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.310462 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.310666 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.310781 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.310977 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.311101 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.311273 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.311371 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.311577 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.311665 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.311876 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312001 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312179 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312279 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312480 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312570 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312790 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.312878 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.313083 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.313185 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.313405 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.313506 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.313714 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.313802 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314023 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314113 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314324 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314436 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314627 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314713 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.314926 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315020 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315230 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315318 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315531 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315625 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315836 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.315930 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.316137 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.316224 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.316438 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.316528 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.316738 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.316827 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317038 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317123 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317338 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317454 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317688 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317781 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.317993 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318081 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318296 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318411 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318599 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318687 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318902 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.318991 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.319223 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.319320 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.319534 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.319659 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.319834 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.319961 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.320140 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.320241 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.320444 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.320535 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.320779 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.320872 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.321083 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.321171 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.321434 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.321526 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.321722 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.321810 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322023 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322112 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322336 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322436 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322646 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322735 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.322959 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323054 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323258 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323347 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323561 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323653 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323876 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.323964 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.324185 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.324273 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.324492 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.324586 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.324798 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.324892 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.325104 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.325192 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.325443 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.325561 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.325815 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.325984 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.326144 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.326243 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.326416 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.326537 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.326722 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.326865 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327028 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327192 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327337 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327500 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327650 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327816 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.327958 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.328129 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.328267 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.328439 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.328574 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.328752 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.328881 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.329064 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.329232 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.329379 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.329519 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.329715 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.329804 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330027 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330127 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330340 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330428 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330651 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330740 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.330960 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331056 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331267 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331361 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331570 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331657 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331874 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.331968 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.332173 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.332267 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.332496 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.332583 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.332802 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.332897 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.333115 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.333205 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.333442 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.333545 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.333756 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.333846 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334061 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334150 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334386 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334478 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334698 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334786 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.334998 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.335086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.335379 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.335473 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.335693 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.335782 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336004 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336091 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336312 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336407 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336615 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336704 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.336916 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337002 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337221 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337320 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337568 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337671 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337876 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.337965 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.338176 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.338272 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.338477 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.338565 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.338796 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.338888 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.339098 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.339194 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.339415 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.339510 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.339733 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.339820 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340037 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340166 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340341 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340430 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340665 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340807 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.340970 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.341119 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.341835 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.342050 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.342371 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.342503 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.342685 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.342776 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.342996 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.343085 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.343298 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.343412 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.343615 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.343727 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.343924 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.344041 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.344245 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.344366 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.344566 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.344690 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.344877 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345015 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345192 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345328 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345517 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345672 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345838 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.345994 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.346156 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.346310 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.346466 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.346634 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.346785 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.346950 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.347191 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.347288 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.347510 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.347598 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.347827 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.347924 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.348145 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.348313 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.348464 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.348636 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.348774 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.348893 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.349075 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.349176 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.349400 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.349531 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.349701 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.349847 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350003 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350174 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350326 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350499 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350595 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350808 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.350896 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.351115 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.351218 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.351427 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.351522 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.351733 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.351824 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352041 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352139 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352362 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352450 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352659 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352746 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.352969 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.353058 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.353279 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.353372 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.353613 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.353700 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.353920 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354010 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354219 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354309 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354538 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354633 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354838 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.354935 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.355137 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.355225 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.355437 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.355525 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.355736 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.355825 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.356072 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.356167 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.356372 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.356468 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.356686 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.356774 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.357081 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.357227 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.357425 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.357605 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.357705 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.357910 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358008 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358243 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358337 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358567 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358657 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358881 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.358969 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.359196 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.359284 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.359515 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.359605 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.359817 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.359913 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.360120 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.360218 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.360428 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.360526 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.360731 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.360820 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361035 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361133 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361339 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361473 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361671 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361809 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.361973 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362075 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362276 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362364 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362578 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362666 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362886 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.362987 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.363185 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.363272 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.363493 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.363580 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.363797 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.363904 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.364100 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.364192 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.364403 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.364502 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.364700 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.364794 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365018 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365112 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365323 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365457 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365669 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365758 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.365976 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366072 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366284 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366373 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366588 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366677 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366896 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.366984 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.367216 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.367316 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.367537 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.367635 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.367852 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.367940 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.368164 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.368306 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.368481 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.368576 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.368791 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.368885 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.369102 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.369203 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.369430 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.369537 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.369741 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.369831 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370056 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370152 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370367 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370507 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370682 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370770 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.370998 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.371194 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.371317 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.371520 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.371614 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.371830 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.371927 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.372139 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.372228 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.372961 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.373095 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.373284 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.373599 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.373705 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.373912 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374001 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374218 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374308 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374525 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374617 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374831 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.374921 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.375144 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.375239 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.375460 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.375549 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.375777 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.375865 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.376088 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.376185 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.376400 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.376489 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.376709 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.376795 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.377019 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.377117 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.377332 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.377471 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.377681 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.377769 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378012 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378108 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378317 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378406 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378628 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378715 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.378940 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379035 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379250 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379338 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379562 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379658 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379869 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.379964 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.380181 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.380268 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.380491 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.380637 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.380799 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.380888 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.381105 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.381193 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.381436 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.381545 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.381753 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.381861 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.382075 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.382404 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.382508 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.382841 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.383160 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.383475 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.383663 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.383795 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.383976 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.384113 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.384291 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.384440 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.384609 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.384775 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.385097 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.385196 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.385434 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.385526 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.385759 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.385860 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.386077 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.386166 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.386396 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.386596 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.386707 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.386914 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387007 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387249 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387337 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387576 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387664 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387900 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.387990 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.388264 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.388418 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.388552 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.388705 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.388862 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.388959 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.389181 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.389269 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.389510 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.389615 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.389810 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.389898 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.390121 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.390208 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.390425 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.390521 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.390747 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.390950 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.391060 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.391294 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.391382 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.391609 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.391706 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.391933 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.392028 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.392257 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.392483 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.392574 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.392827 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.392915 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.393143 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.393240 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.393481 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.393571 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.393786 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.393875 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.394099 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.394187 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.394403 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.394492 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.394704 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.394791 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395007 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395095 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395308 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395396 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395614 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395701 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.395917 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396018 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396221 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396308 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396520 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396606 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396827 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.396926 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.397133 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.397229 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.397460 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.397551 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.397767 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.397868 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398071 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398159 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398371 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398458 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398680 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398963 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.398963 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399128 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399272 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399361 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399581 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399668 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399881 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.399968 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.400184 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.400272 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.400485 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.400574 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.400786 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.400874 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.401086 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.401182 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.401428 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.401569 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.401764 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.401917 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402004 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402071 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402318 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402419 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402618 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402708 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.402929 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.403026 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.403232 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.403321 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.403549 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.404232 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.404472 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.404630 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.404939 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.405155 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.405489 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.405633 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.405816 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.405971 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.406399 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.406617 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.406713 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.407009 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.407099 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.407337 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.407417 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.407662 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.407751 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408012 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408200 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408321 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408583 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408724 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408909 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.408999 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.409281 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.409380 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.409602 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.409701 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.409917 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410006 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410235 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410365 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410536 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410629 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410845 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.410942 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.411155 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.411246 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.411465 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.411552 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.411773 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.411875 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.412082 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.412176 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.412392 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.412485 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.412704 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.412800 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413015 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413108 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413325 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413434 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413663 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413768 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.413979 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.414078 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.414285 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.414371 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.414596 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.414687 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.414905 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415000 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415214 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415323 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415532 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415632 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415839 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.415927 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.416155 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.416244 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.416458 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.416552 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.416763 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.416871 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.417078 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.417178 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.417429 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.417525 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.417750 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.417852 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.418057 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.418154 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.418418 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.418504 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.418748 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.418903 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.419059 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.419208 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.419441 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.419679 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.419897 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420046 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420151 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420236 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420409 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420499 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420735 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.420825 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421057 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421153 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421359 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421512 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421688 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421778 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.421991 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.422088 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.422303 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.422400 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.422631 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.422732 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.422962 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423051 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423270 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423366 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423575 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423672 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423882 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.423977 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.424200 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.424289 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.424510 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.424606 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.424829 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.424919 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.425150 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.425236 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.425481 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.425585 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.425793 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.425889 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.426108 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.426202 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.426417 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.426506 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.426728 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.426817 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427039 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427128 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427347 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427445 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427653 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427748 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.427959 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428048 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428267 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428355 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428580 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428676 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428890 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.428984 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.429199 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.429287 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.429536 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.429626 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.429856 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.429960 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.430171 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.430269 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.430475 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.430570 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.430798 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.430893 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.431108 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.431197 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.431422 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.431520 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.431731 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.431820 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432040 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432135 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432352 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432440 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432666 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432754 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.432984 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.433072 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.433294 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.433414 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.433632 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.433722 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.433950 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.434038 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.434267 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.434355 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.434585 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.434673 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.434911 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.435518 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.435746 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.435954 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436107 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436257 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436383 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436471 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436650 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436749 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.436889 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:02:29.437030 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.437356 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.437695 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.438008 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.438312 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:02:29.438552 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:02:29.459417 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.460605 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_db.sqlalchemy.engines [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.524970 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.context [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309b8a82-e599-4304-b992-62cc90d7ef9e(cell1) {{(pid=101865) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:02:29.525666 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.context [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309b8a82-e599-4304-b992-62cc90d7ef9e(cell1) {{(pid=101866) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:02:29.529961 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:02:29.530419 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:02:29.531766 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:02:29.532284 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:02:29.532548 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:02:29.533075 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:02:29.534525 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:02:29.535052 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:02:29.545498 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.548523 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_db.sqlalchemy.engines [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.551798 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.554452 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_db.sqlalchemy.engines [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.717184 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:29.777762 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_db.sqlalchemy.engines [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:02:30.117927 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:02:30.125541 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:02:30.143680 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: WARNING keystonemiddleware.auth_token [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:02:30.150221 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: WARNING keystonemiddleware.auth_token [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:02:30.467395 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:02:30.472673 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:02:30.477793 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581311d99c0 pid: 101865 (default app) Dec 15 16:02:30.479868 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:30.481047 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Dec 15 16:02:30.481458 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Dec 15 16:02:30 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:02:30.520728 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: WARNING keystonemiddleware.auth_token [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:02:30.525983 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: WARNING keystonemiddleware.auth_token [None req-8695fefd-6e55-4b92-912b-0a965a3856f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:02:30.532638 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581311d99c0 pid: 101866 (default app) Dec 15 16:03:52.966191 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:03:52.967189 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Dec 15 16:03:52.967579 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:03:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:03:53.396149 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-54fdf84a-9506-4e47-b365-42144b1c0454 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:03:53.426352 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-54fdf84a-9506-4e47-b365-42144b1c0454 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451400 Dec 15 16:03:53.427093 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 16:03:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:03:55.847704 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:03:55.848698 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-95af0cd9-06c3-48fb-b53e-d62261e3d460 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 15 16:03:55.849098 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:03:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:03:55.912098 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-aa2b88da-7c87-4278-a8c5-6dc19bb66cc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "c1", "disk": 1, "ram": 256, "name": "cirros256"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:03:55.930943 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:03:55.930943 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: warnings.warn(msg) Dec 15 16:03:55.962373 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-aa2b88da-7c87-4278-a8c5-6dc19bb66cc5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106906 Dec 15 16:03:55.963204 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:03:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:03:56.192805 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-bc1d75a6-156b-4faa-b978-dae74b1f2cea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:03:56.195359 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:03:56.195359 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: warnings.warn(msg) Dec 15 16:03:56.261653 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-bc1d75a6-156b-4faa-b978-dae74b1f2cea admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289389 Dec 15 16:03:56.270440 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 16:03:55 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:03:58.682144 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-aa2b88da-7c87-4278-a8c5-6dc19bb66cc5 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:03:58.683149 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-aa2b88da-7c87-4278-a8c5-6dc19bb66cc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Dec 15 16:03:58.683545 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:03:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:03:58.805858 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-178c5a1d-2e4b-41a3-9cf1-6be23571919a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:03:58.826691 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:03:58.826691 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: warnings.warn(msg) Dec 15 16:03:58.847451 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-178c5a1d-2e4b-41a3-9cf1-6be23571919a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156903 Dec 15 16:03:58.848018 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:03:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:03:58.862192 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-d0e4c6f1-8568-4079-8a03-626d9efe5227 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:03:58.863597 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:03:58.863597 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: warnings.warn(msg) Dec 15 16:03:58.905802 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-d0e4c6f1-8568-4079-8a03-626d9efe5227 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048291 Dec 15 16:03:58.907345 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 16:03:58 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:04:01.378463 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-178c5a1d-2e4b-41a3-9cf1-6be23571919a admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:01.379749 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-178c5a1d-2e4b-41a3-9cf1-6be23571919a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Dec 15 16:04:01.380334 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:04:01.441071 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9182d055-8f48-4e03-a0af-60f385166c98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:01.461166 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9182d055-8f48-4e03-a0af-60f385166c98 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074509 Dec 15 16:04:01.462127 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:04:01.475164 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-65e3adc4-5d5a-4a9e-aab8-22f3db2e72ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:01.499126 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-65e3adc4-5d5a-4a9e-aab8-22f3db2e72ec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027693 Dec 15 16:04:01.500755 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 16:04:01 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:04:03.941268 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9182d055-8f48-4e03-a0af-60f385166c98 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:03.942316 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9182d055-8f48-4e03-a0af-60f385166c98 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 15 16:04:03.942724 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:04.000242 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-e8cc9fc4-5806-43c9-a570-3adb217742d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:04.017167 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-e8cc9fc4-5806-43c9-a570-3adb217742d2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068021 Dec 15 16:04:04.017766 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:04:04.029931 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-12675ecd-5dd2-4075-9a7c-103b69df099d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:04.053775 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-12675ecd-5dd2-4075-9a7c-103b69df099d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027553 Dec 15 16:04:04.054482 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 16:04:04 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:04:06.493948 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-e8cc9fc4-5806-43c9-a570-3adb217742d2 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:06.494940 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-e8cc9fc4-5806-43c9-a570-3adb217742d2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 15 16:04:06.495333 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:06.556172 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-3e34f513-a982-4e36-b30a-4733cf78f8df admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:06.575721 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-3e34f513-a982-4e36-b30a-4733cf78f8df admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073657 Dec 15 16:04:06.576376 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:04:06.589238 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-2e9a65f9-2ccf-4005-8ffe-c7334bccdab8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:06.613171 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-2e9a65f9-2ccf-4005-8ffe-c7334bccdab8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027550 Dec 15 16:04:06.613894 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Dec 15 16:04:06 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:04:09.098952 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-3e34f513-a982-4e36-b30a-4733cf78f8df admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:09.099988 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-3e34f513-a982-4e36-b30a-4733cf78f8df admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Dec 15 16:04:09.100425 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:09.183786 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-43112120-9fbd-4941-b5fa-6c419d820ce0 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:09.215869 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-43112120-9fbd-4941-b5fa-6c419d820ce0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.105917 Dec 15 16:04:09.217227 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 16:04:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:04:11.949096 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-3e34f513-a982-4e36-b30a-4733cf78f8df admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:11.950155 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-3e34f513-a982-4e36-b30a-4733cf78f8df admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Dec 15 16:04:11.950556 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:12.016711 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-2c233771-760c-4c3b-bcc3-1b94c42b6028 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:12.037711 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-2c233771-760c-4c3b-bcc3-1b94c42b6028 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079730 Dec 15 16:04:12.038444 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:11 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:04:12.052900 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-48aafe99-1214-4807-8dc9-7e676e7d322c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:12.083199 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-48aafe99-1214-4807-8dc9-7e676e7d322c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033940 Dec 15 16:04:12.083799 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 16:04:12 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:04:14.567477 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-2c233771-760c-4c3b-bcc3-1b94c42b6028 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:14.568464 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-2c233771-760c-4c3b-bcc3-1b94c42b6028 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 15 16:04:14.568855 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:14.628017 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-fcebbeac-fd35-44ea-bae0-ad1d74c59a10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "swap": 0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:14.645547 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-fcebbeac-fd35-44ea-bae0-ad1d74c59a10 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070336 Dec 15 16:04:14.646086 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:14 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:04:14.658952 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-eb8b8949-bc89-41c6-b666-c4422e7083d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:14.681691 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-eb8b8949-bc89-41c6-b666-c4422e7083d0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027164 Dec 15 16:04:14.682247 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 16:04:14 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:04:17.083605 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-fcebbeac-fd35-44ea-bae0-ad1d74c59a10 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:17.084609 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-fcebbeac-fd35-44ea-bae0-ad1d74c59a10 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 15 16:04:17.085012 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:17.144802 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-3fa2d1ae-e283-4673-b108-3c616e4ef00c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "ram": 4096}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:17.162979 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-3fa2d1ae-e283-4673-b108-3c616e4ef00c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071526 Dec 15 16:04:17.163526 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:17 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:04:17.176147 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-8cb1c551-8036-4100-b132-a20852c36db4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:17.199812 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-8cb1c551-8036-4100-b132-a20852c36db4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027809 Dec 15 16:04:17.200397 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 16:04:17 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:04:19.681341 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-3fa2d1ae-e283-4673-b108-3c616e4ef00c admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:19.682425 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-3fa2d1ae-e283-4673-b108-3c616e4ef00c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Dec 15 16:04:19.683055 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:19.748938 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-363444d3-ffa5-49b8-be31-df5933f06547 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "disk": 80}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:19.768421 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-363444d3-ffa5-49b8-be31-df5933f06547 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078981 Dec 15 16:04:19.768942 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:04:19.781606 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-e9d5cd97-2c42-44c8-89e6-9fb27ef9760d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:19.805139 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-e9d5cd97-2c42-44c8-89e6-9fb27ef9760d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027552 Dec 15 16:04:19.806293 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 16:04:19 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:04:22.294384 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-363444d3-ffa5-49b8-be31-df5933f06547 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:22.295309 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-363444d3-ffa5-49b8-be31-df5933f06547 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 15 16:04:22.295848 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:22.360577 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-cc2a7790-5096-4cb3-ab62-9f3683be7bbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:22.381531 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-cc2a7790-5096-4cb3-ab62-9f3683be7bbc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077010 Dec 15 16:04:22.382553 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Dec 15 16:04:22 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:04:22.394987 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-f375b776-097e-41c5-8ff8-646a60e81c7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:22.420749 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-f375b776-097e-41c5-8ff8-646a60e81c7b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030203 Dec 15 16:04:22.421606 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Dec 15 16:04:22 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:04:43.134616 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-cc2a7790-5096-4cb3-ab62-9f3683be7bbc admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:43.135618 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-cc2a7790-5096-4cb3-ab62-9f3683be7bbc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 15 16:04:43.136004 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:04:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:43.195177 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-0114e166-2a0e-4344-91a8-cb564de19896 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:43.212026 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-0114e166-2a0e-4344-91a8-cb564de19896 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068988 Dec 15 16:04:43.212545 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 16:04:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:04:44.806154 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-cc2a7790-5096-4cb3-ab62-9f3683be7bbc admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:44.807201 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-cc2a7790-5096-4cb3-ab62-9f3683be7bbc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Dec 15 16:04:44.807594 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:44.997406 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-c9281407-91e0-422b-bd9a-bce794bba110 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:45.003415 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.wsgi [None req-c9281407-91e0-422b-bd9a-bce794bba110 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:04:45.003971 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-c9281407-91e0-422b-bd9a-bce794bba110 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:04:45.004763 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-c9281407-91e0-422b-bd9a-bce794bba110 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058039 Dec 15 16:04:45.005266 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 16:04:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:45.014909 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-1f396854-cd8a-4f1a-a781-8baf28dd6cc0 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:45.036454 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-1f396854-cd8a-4f1a-a781-8baf28dd6cc0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025010 Dec 15 16:04:45.037204 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 16:04:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:04:45.047517 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-486cebb0-9d34-4f27-8fc9-e76ff9e8b09d admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:45.068639 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-486cebb0-9d34-4f27-8fc9-e76ff9e8b09d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024609 Dec 15 16:04:45.069173 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 16:04:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:04:45.078993 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-6e620f85-a412-4b7a-92bf-40a170b8cc98 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:45.084541 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-6e620f85-a412-4b7a-92bf-40a170b8cc98 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:04:45.085106 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-6e620f85-a412-4b7a-92bf-40a170b8cc98 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:04:45.085923 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-6e620f85-a412-4b7a-92bf-40a170b8cc98 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010459 Dec 15 16:04:45.086405 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 16:04:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 16:04:46.576615 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-486cebb0-9d34-4f27-8fc9-e76ff9e8b09d admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:46.577659 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-486cebb0-9d34-4f27-8fc9-e76ff9e8b09d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 15 16:04:46.578051 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:46.769775 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c41015c2-647b-48c8-b743-969a1b351681 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:46.775348 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-c41015c2-647b-48c8-b743-969a1b351681 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:04:46.775902 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c41015c2-647b-48c8-b743-969a1b351681 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:04:46.776679 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-c41015c2-647b-48c8-b743-969a1b351681 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057860 Dec 15 16:04:46.777171 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 16:04:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:46.787946 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-753faa59-cda2-4715-94ca-483da3af06f7 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:46.801528 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-753faa59-cda2-4715-94ca-483da3af06f7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017610 Dec 15 16:04:46.802074 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 16:04:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:04:46.811772 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-5d970fdf-4248-4b3f-aad5-cfbd98ce5e98 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:46.824971 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-5d970fdf-4248-4b3f-aad5-cfbd98ce5e98 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016619 Dec 15 16:04:46.825518 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 16:04:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:04:46.835506 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-3e9b4b2b-92c3-4b62-bb10-b0e25d22395b admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:46.840700 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.wsgi [None req-3e9b4b2b-92c3-4b62-bb10-b0e25d22395b admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:04:46.841252 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-3e9b4b2b-92c3-4b62-bb10-b0e25d22395b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:04:46.842063 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-3e9b4b2b-92c3-4b62-bb10-b0e25d22395b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010077 Dec 15 16:04:46.842546 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Dec 15 16:04:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 16:04:48.311484 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-5d970fdf-4248-4b3f-aad5-cfbd98ce5e98 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:48.312477 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-5d970fdf-4248-4b3f-aad5-cfbd98ce5e98 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Dec 15 16:04:48.312876 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:48.504257 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-06a93ac2-98a6-43b2-baf6-37df9fadbea6 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:48.509349 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.wsgi [None req-06a93ac2-98a6-43b2-baf6-37df9fadbea6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:04:48.510107 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-06a93ac2-98a6-43b2-baf6-37df9fadbea6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:04:48.510883 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-06a93ac2-98a6-43b2-baf6-37df9fadbea6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059294 Dec 15 16:04:48.511369 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 16:04:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:48.521561 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-00c0a328-7408-4acc-977e-2c071c1a5464 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:48.535111 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-00c0a328-7408-4acc-977e-2c071c1a5464 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017644 Dec 15 16:04:48.535624 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 16:04:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:04:48.545908 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:48.558745 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016591 Dec 15 16:04:48.559197 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Dec 15 16:04:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:04:48.568855 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-11e56e6e-29df-4995-9152-faecaf6bd948 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:48.573956 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-11e56e6e-29df-4995-9152-faecaf6bd948 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:04:48.574504 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-11e56e6e-29df-4995-9152-faecaf6bd948 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:04:48.575274 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-11e56e6e-29df-4995-9152-faecaf6bd948 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009944 Dec 15 16:04:48.575751 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 16:04:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 16:04:50.073778 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:50.074799 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Dec 15 16:04:50.075197 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:50.269301 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-795be050-5100-4925-854f-eb433cf5ff22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:50.288044 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-795be050-5100-4925-854f-eb433cf5ff22 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069931 Dec 15 16:04:50.288516 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 16:04:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:04:51.768580 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:51.770128 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Dec 15 16:04:51.770521 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:51.959354 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-f9409811-b5f5-453f-b22d-b654db33b08a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:51.977565 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-f9409811-b5f5-453f-b22d-b654db33b08a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069741 Dec 15 16:04:51.978224 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 16:04:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:04:53.495337 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:53.496315 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Dec 15 16:04:53.496703 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:53.685188 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-05854d1d-f320-4e8b-9787-29d165bc6b70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:53.703269 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-05854d1d-f320-4e8b-9787-29d165bc6b70 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068890 Dec 15 16:04:53.703967 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 16:04:53 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:04:55.185301 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:55.186319 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Dec 15 16:04:55.186707 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:55.380588 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-f9183b39-5b2e-47e7-a977-aa6c5398e9a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:04:55.399468 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-f9183b39-5b2e-47e7-a977-aa6c5398e9a3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070366 Dec 15 16:04:55.399999 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Dec 15 16:04:55 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:04:56.880586 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:56.881629 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Dec 15 16:04:56.882009 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:04:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:04:57.073449 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-7b3be3ff-d3ec-4df2-9daa-172c3685f078 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:04:57.092652 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-7b3be3ff-d3ec-4df2-9daa-172c3685f078 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070516 Dec 15 16:04:57.093109 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Dec 15 16:04:57 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:05:46.139280 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:46.140274 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-9ec524c5-cd7c-4997-9b23-dc34ec4a8bbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Dec 15 16:05:46.140676 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Wed Dec 15 16:05:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:05:46.198531 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-00edb7ba-3316-4dc4-a3a5-866fdb8ce458 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:46.217484 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-00edb7ba-3316-4dc4-a3a5-866fdb8ce458 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069735 Dec 15 16:05:46.218006 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Dec 15 16:05:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:05:46.240397 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-0cc6a36d-d63c-4e85-a5db-f870f2b0b1c3 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:46.248066 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-0cc6a36d-d63c-4e85-a5db-f870f2b0b1c3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011434 Dec 15 16:05:46.248586 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Dec 15 16:05:46 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:05:46.259946 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-8f50e972-3395-4dc4-9232-e90b346405a9 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:46.267363 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-8f50e972-3395-4dc4-9232-e90b346405a9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010822 Dec 15 16:05:46.267858 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Dec 15 16:05:46 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:05:46.280906 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-531414e5-37b1-48c2-8c80-ee08658d3c60 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:46.289105 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-531414e5-37b1-48c2-8c80-ee08658d3c60 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012690 Dec 15 16:05:46.289672 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Dec 15 16:05:46 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:05:46.301663 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:46.309116 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010969 Dec 15 16:05:46.309667 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Dec 15 16:05:46 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:09.858526 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-46bfef0c-709a-483a-bb91-00690011350d tempest-verify_tempest_config-1911016846 tempest-verify_tempest_config-1911016846-project] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:09.860480 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-46bfef0c-709a-483a-bb91-00690011350d tempest-verify_tempest_config-1911016846 tempest-verify_tempest_config-1911016846-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106844 Dec 15 16:07:09.861009 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Dec 15 16:07:09 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:08:38.066311 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:38.067379 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Dec 15 16:08:38.081235 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:08:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:38.328609 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-0234db82-9458-4a6c-b9cf-e5774af3c6e3 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:38.329813 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:38.329813 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: warnings.warn(msg) Dec 15 16:08:38.331355 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-0234db82-9458-4a6c-b9cf-e5774af3c6e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.331800 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-0234db82-9458-4a6c-b9cf-e5774af3c6e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.332583 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-0234db82-9458-4a6c-b9cf-e5774af3c6e3 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.333003 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-0234db82-9458-4a6c-b9cf-e5774af3c6e3 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.367343 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-0234db82-9458-4a6c-b9cf-e5774af3c6e3 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146830 Dec 15 16:08:38.367895 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 35/71] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 16:08:38 2021] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:39.883387 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:39.884370 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 15 16:08:39.884749 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 37/72] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:08:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:40.080493 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-91876c1e-14a8-4b1f-8d6d-3b96bfc5c117 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:40.081752 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:40.081752 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: warnings.warn(msg) Dec 15 16:08:40.083343 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-91876c1e-14a8-4b1f-8d6d-3b96bfc5c117 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.083782 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-91876c1e-14a8-4b1f-8d6d-3b96bfc5c117 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.084562 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-91876c1e-14a8-4b1f-8d6d-3b96bfc5c117 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.084980 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-91876c1e-14a8-4b1f-8d6d-3b96bfc5c117 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.104094 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-91876c1e-14a8-4b1f-8d6d-3b96bfc5c117 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076327 Dec 15 16:08:40.104569 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 36/73] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 16:08:40 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:08:52.058736 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:52.059808 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Dec 15 16:08:52.060232 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:08:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:52.255022 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-23495bae-4973-4aa9-9975-8dfa56167df8 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:52.256244 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:52.256244 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: warnings.warn(msg) Dec 15 16:08:52.257839 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-23495bae-4973-4aa9-9975-8dfa56167df8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.258336 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-23495bae-4973-4aa9-9975-8dfa56167df8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.259117 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-23495bae-4973-4aa9-9975-8dfa56167df8 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.259600 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-23495bae-4973-4aa9-9975-8dfa56167df8 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.283327 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-23495bae-4973-4aa9-9975-8dfa56167df8 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079640 Dec 15 16:08:52.283812 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 37/75] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 16:08:52 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:53.784648 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:53.785685 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-66f9d597-9fa7-45e4-807f-d900963b299e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Dec 15 16:08:53.786343 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 39/76] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Dec 15 16:08:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:53.981099 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG nova.api.openstack.wsgi [None req-a772b2a4-dc02-4201-9a6d-c041d4389484 admin admin] Calling method '>' {{(pid=101866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:53.982378 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:53.982378 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: warnings.warn(msg) Dec 15 16:08:53.983887 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-a772b2a4-dc02-4201-9a6d-c041d4389484 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.984322 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-a772b2a4-dc02-4201-9a6d-c041d4389484 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.985156 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-a772b2a4-dc02-4201-9a6d-c041d4389484 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.985611 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: DEBUG oslo_concurrency.lockutils [None req-a772b2a4-dc02-4201-9a6d-c041d4389484 admin admin] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.006611 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: INFO nova.api.openstack.requestlog [None req-a772b2a4-dc02-4201-9a6d-c041d4389484 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078517 Dec 15 16:08:54.007150 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: [pid: 101866|app: 0|req: 38/77] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Dec 15 16:08:53 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:52.722937 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: Wed Dec 15 16:09:52 2021 - graceful shutdown triggered... Dec 15 16:09:52.728603 dv-cinder-800704-2-iscsi devstack@n-api.service[101866]: Gracefully killing worker 2 (pid: 101866)... Dec 15 16:09:52.725738 dv-cinder-800704-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 16:09:52.729635 dv-cinder-800704-2-iscsi devstack@n-api.service[101865]: Gracefully killing worker 1 (pid: 101865)... Dec 15 16:09:53.723953 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: worker 1 buried after 1 seconds Dec 15 16:09:53.724428 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: worker 2 buried after 1 seconds Dec 15 16:09:53.724428 dv-cinder-800704-2-iscsi devstack@n-api.service[101864]: goodbye to uWSGI. Dec 15 16:09:53.725752 dv-cinder-800704-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 16:09:53.726400 dv-cinder-800704-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 16:09:53.729318 dv-cinder-800704-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:09:53.740452 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:09:53 2021] *** Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: nodename: dv-cinder-800704-2-iscsi Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: machine: x86_64 Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: clock source: unix Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: pcre jit disabled Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: detected number of CPU cores: 4 Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: current working directory: / Dec 15 16:09:53.742720 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: your processes number limit is 47680 Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: your memory page size is 4096 bytes Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: detected max file descriptor number: 2048 Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: lock engine: pthread robust mutexes Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: thunder lock: enabled Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:09:53.743394 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:09:53.790817 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: Python main interpreter initialized at 0x563bb74429c0 Dec 15 16:09:53.790817 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: python threads support enabled Dec 15 16:09:53.790817 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: your server socket listen backlog is limited to 100 connections Dec 15 16:09:53.790817 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:09:53.791174 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:09:53.791174 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: *** Operational MODE: preforking *** Dec 15 16:09:53.791464 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:09:53.791464 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: spawned uWSGI master process (pid: 116065) Dec 15 16:09:53.791667 dv-cinder-800704-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:09:53.793876 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: spawned uWSGI worker 1 (pid: 116083, cores: 1) Dec 15 16:09:53.793876 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: spawned uWSGI worker 2 (pid: 116084, cores: 1) Dec 15 16:09:53.793876 dv-cinder-800704-2-iscsi devstack@n-api.service[116065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:09:55.719121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:09:55.719121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: from cryptography.utils import int_from_bytes Dec 15 16:09:55.720239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:09:55.720239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: from cryptography.utils import int_from_bytes Dec 15 16:09:55.760616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:09:55.760616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: from cryptography.utils import int_from_bytes Dec 15 16:09:55.761991 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:09:55.761991 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: from cryptography.utils import int_from_bytes Dec 15 16:09:58.179633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:09:58.180202 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:09:58.180498 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:09:58.180740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:09:58.180996 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:09:58.181422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.181731 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.182054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.182373 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.183350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.183840 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.184103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.184430 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.184757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.185019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.185336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.185687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800704-2-iscsi {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.186010 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.186317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.186689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.186947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.187261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.187567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.187865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.188360 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190530 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.190962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.191284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.191568 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:09:58.191983 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.192125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:09:58.192228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800704-2-iscsi {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.192546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:09:58.192832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.192832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.193275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:09:58.193275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:09:58.193724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.193951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.194167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.194383 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.194602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.194822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.195034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.195275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.195481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.195699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.195926 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.196152 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.196358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.196585 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.196796 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.197019 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.197209 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.197354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.197583 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.197747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.197924 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.198100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.198328 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.198670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800704-2-iscsi {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.198883 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199344 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199645 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.199980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.200218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.200396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.200540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.200540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.200849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.200990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.201140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.201300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.201300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.202271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.202463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.202671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.202906 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.203967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.204115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.204266 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.204425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.204566 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.204719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.204859 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.205914 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800704-2-iscsi {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.206064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.206216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.206408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.206557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.206708 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.206889 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207478 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207618 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207767 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.207914 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208676 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.208978 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.209126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.209277 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.209447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.209599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.209754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.209901 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.210048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.210198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.210387 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.210538 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.210765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.210965 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.211119 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.211268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.211415 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.211562 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.211888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.212445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.212589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.212737 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.212900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.213048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.213200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.213341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.213568 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.213753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.214078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.214239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.214425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.214760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.214947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.215160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.215340 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.215492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.215645 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.215786 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.215945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216837 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.216987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.217149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.217297 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.217467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.217614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.217762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.217916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218059 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.218954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.219171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.219324 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.219465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.219612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.219766 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.219916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.220987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.221148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.221323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.221323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.221642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.221939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.222550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.222710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.222865 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223015 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223156 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.223882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.224022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.224276 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.224435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.224616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.224772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.224975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.225156 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.225307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.225483 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.225628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.225774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.225774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226492 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226678 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.226963 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.227118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.227292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.227442 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.227591 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.227591 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.227876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.228029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.228177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.228317 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.228456 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.228597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.228890 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.229061 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.229206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.229353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.230077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.230231 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.230384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.230577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.230745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.230925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.230925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.231198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.231357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.231515 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.234304 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.234571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.234774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.234970 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.235139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.235331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.235480 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.235640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.235792 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.235945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.236087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.236235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.236408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.236687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.236863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.237352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.237570 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.237736 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.237885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.238038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.238193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.238345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.238487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.238628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.238782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.238925 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.239121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.239263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.239405 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.239559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.239711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.239859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.240000 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.240150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.240292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.240444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.240593 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.240741 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.240881 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.240881 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.241162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.241311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.241485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.241647 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.241789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.241936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.242226 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.242701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.242890 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.243069 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.243216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.243390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.243545 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.243687 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.243834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.243984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.244175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.244454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.244636 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.244882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.245175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.245867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:09:58.246022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.246164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.246306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.246464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.246610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.246836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.246996 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.247171 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.247326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.247326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.247611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.247761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.247909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248773 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.248930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.249085 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.249235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.249413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.249563 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.249710 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.249860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.250014 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.250182 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.250466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.250637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.250783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.250957 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.251128 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.251271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.251449 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.251605 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.251747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.251888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.252037 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.252343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.252518 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.252944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.253094 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.253247 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.253420 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.253567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.253720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.253862 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254002 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254156 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254304 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254471 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.254894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.255323 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.255467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.255619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.255769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.255919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.256069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.256220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.256361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.256510 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.256660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.256826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257049 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257527 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257679 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.257982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.258129 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.258270 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.258270 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.261418 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.261608 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.261776 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.261932 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.262079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.262222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.262546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.262696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.263166 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.263359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.263515 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.263667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.263808 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.264093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.264256 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.264401 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.264541 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.264682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.264944 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.265139 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.265458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.265611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.265754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.265895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266336 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.266924 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.267205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.267367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.267543 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.267688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.267828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.267981 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.268122 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.268268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.268421 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.268581 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.268766 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.268960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.269104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.269267 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.269458 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.269606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.269761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.269911 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270060 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270208 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270349 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270793 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.270942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.271084 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.271224 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.271408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.271569 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.271754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.271901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.272042 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.272183 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.272331 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.272650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.272812 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.272980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.273494 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.273687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.273842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.273993 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.274135 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.274276 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.274415 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.274564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.274752 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.274908 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.275173 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.275322 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.275566 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.275723 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.275872 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.276074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.276232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.276452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.276608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.276759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.276988 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.277132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.277373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.277544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.277696 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.277848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.278003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.278379 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.278555 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.278698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.278847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.278997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.279147 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.279297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.279482 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.279638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.279780 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.279921 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.280071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.280220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.280367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.280528 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.280768 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.280953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.281099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.281240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.281380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.281580 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.281722 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.281880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.282023 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.282164 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.282304 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.282454 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.282596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.282925 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.283116 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.283946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284093 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284852 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.284994 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.285145 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.285412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.285809 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.285971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.285971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.286371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.286516 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.286659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.286866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.287034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.287189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.287530 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.287688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.287846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.288046 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.288199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.288199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.288607 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.288800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.288969 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289090 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.289899 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.290011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.290282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.290458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.290644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.290876 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.291035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.291185 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.291349 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.291493 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.291649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.291850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.292598 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.292757 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.293128 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.293311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.293834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.294025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.294178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.294360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.294518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.294675 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.294838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.295028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.295028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.295317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.295317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.295659 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.296070 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.296234 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.296385 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.296539 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.296696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.296866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.297026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.297213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.297366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.297649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.297806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.297978 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.298134 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.298320 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.298473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.298619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.298775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.298935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299776 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.299925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.300214 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.300361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.300507 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.300666 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.300824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.300980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.301127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.301273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.301475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.301639 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.301639 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.301937 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302690 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.302844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.303521 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.303963 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.304122 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.304271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.304419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.304578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.304578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.304880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.305025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.305208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.305439 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.305750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.305905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.306265 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.306429 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.306586 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.306741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.306904 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.307072 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.307230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.307385 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.307655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.308395 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.308395 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.308740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.308939 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309090 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309600 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309758 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.309918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.310205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.310361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.310543 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.310706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.310854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.311000 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.311154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.311302 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.311459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.311648 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.311884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312362 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312520 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312676 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.312980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.313463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.313655 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.314094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.314094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.314391 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.314566 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.314715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.314863 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315330 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315330 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.315948 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.316103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.316462 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.316632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.316780 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.316935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317570 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317914 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.317914 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.318198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.318445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.318671 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.318846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.318995 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.319142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.319298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.319446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.319592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.319740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.319918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320073 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320391 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320684 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.320997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.321154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.321311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.321496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.321647 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.321806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.321956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322257 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322257 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322849 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.322996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.323143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.323446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.323748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.323926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.324372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.324521 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.324669 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.324816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.324816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.325110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.325110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.325430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.325585 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.325744 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.325744 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.326035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.326181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.326327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.326665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.326836 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.326988 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.327136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.327282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.327440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.327595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.327757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.327906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328406 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328558 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328558 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.328949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.329246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.329418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.330162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.330162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.330470 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.330617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.330779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.330928 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331088 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331237 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331385 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331820 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.331994 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.332151 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.332308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.332490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.332642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.332642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.332957 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.333106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.333260 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.333446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.333611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.333856 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.334012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.334455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.334613 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.334760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.334915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335530 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.335992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.336152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.336300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.336465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.336878 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337197 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.337987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.338135 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.338290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.338445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.338594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.338776 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.339082 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.339248 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.339396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.339554 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.339703 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.339850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340315 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.340936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341085 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341238 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341638 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.341948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.342236 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.342390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.342538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.342697 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.342864 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.343012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.343159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.343305 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.343451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.343610 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.343760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.344003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.344167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.344627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.344784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.344943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.345092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.345250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.345414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.345568 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.345715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.345877 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.346026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.346172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.346319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.346464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.346626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.346795 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.347133 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.347297 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.347457 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.347612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.347769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.347932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.348081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.348235 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.348383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.348537 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.348767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.348918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349302 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349510 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.349980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.350269 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.350269 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.350704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.350871 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351177 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351478 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351800 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.351947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.352092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.352240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.352385 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.352541 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.352727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.352888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.353044 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.353192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.353346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.353535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.353694 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.353849 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.354021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.354243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.355296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.355516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.355672 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.355821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.355967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.356114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.356276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.356426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.356573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.356573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.356879 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.357055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.357425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.357585 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.357744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.357891 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358510 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358804 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.358974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.359131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.359297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.359516 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.359670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.359816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.359963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.360119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.360269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.360415 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.360570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.360755 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.360921 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.361077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.361225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.361371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.361555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.361713 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362131 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.362889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.363205 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.363353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.363507 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.363662 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.363809 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.364093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.364277 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.364508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.364661 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.364661 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.364940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.365114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.365581 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.366371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.366602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.366800 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.366961 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.367113 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.367268 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.368053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.368261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.368423 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.368580 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.368729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.368927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.369092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.369242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.369419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.369673 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.369829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.369977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.370294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.370448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.370596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.370744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.370900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.370900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.371209 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.371365 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.371514 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.371668 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.371816 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.371976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.372124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.372272 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.372420 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.372565 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.372711 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.372866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.373032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.373187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.373343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.373596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.373748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.373910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.374137 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.374289 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.374444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.374717 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.374874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.375022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.375178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.375366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.375873 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376039 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376190 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376339 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376487 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376487 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376776 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.376933 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.377090 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.377237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.377458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.377626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.377820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.378554 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.378724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.378875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.379255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.379415 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.379576 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.379844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.380001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.380159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.380373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.380653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.380851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.380973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381091 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381209 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381650 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.381902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382153 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382329 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382413 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382513 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382613 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.382882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383382 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383565 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383843 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.383936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384272 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384362 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384455 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384540 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384540 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384810 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.384893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.385176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.385279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.385365 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.385477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.385577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.386568 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.386673 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.386767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.386852 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.386941 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387032 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387222 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387388 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387564 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387902 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387972 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.387972 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388343 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388671 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388928 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.388999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389248 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389334 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389685 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.389768 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390209 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390289 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390547 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.390963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391042 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391190 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391337 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.391961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.392948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393033 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393115 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393279 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393476 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393561 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393655 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393747 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.393935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394019 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394192 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394479 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394744 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.394930 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395015 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395262 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395394 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395483 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395575 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395843 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.395933 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396190 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396733 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.396911 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397659 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397858 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.397951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398037 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398382 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398678 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398770 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398863 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.398955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399545 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399732 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.399913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400398 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400572 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.400944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.401034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.401116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.401188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.401270 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402262 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402871 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.402980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403235 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403322 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403418 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403504 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403786 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403872 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.403963 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404520 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404624 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.404836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405420 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405796 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.405924 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406260 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.406913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407134 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407251 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407251 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407495 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407737 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407737 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.407952 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.408067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.408187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.408187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.408397 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.408508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.408867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409122 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409377 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409799 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.409918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410259 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410381 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410750 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.410979 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411215 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411362 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411441 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411524 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411524 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411661 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411878 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.411957 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412262 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412567 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412647 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412920 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.412999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413533 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.413885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414014 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414117 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414211 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414303 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414396 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414565 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414660 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.414930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415867 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.415962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416334 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416521 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416613 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416704 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.416946 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417089 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417869 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.417962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418132 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418381 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418477 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418477 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418721 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.418988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419436 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419604 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.419921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420134 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.420928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421019 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421409 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421498 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.421922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422533 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422766 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.422868 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.423091 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.423184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.423406 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.423497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.423718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.423821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.424042 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.424136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.424356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.424457 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.424690 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.424841 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.425984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.426285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.426384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.426594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.426696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.426907 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427037 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427247 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427340 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427602 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427903 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.427995 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.428229 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.428329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.428542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.428636 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.428865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.428955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.429175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.429274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.429522 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.429620 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.429848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.429977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.430167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.430271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.430481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.430579 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.430813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.430915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.431130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.431231 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.431443 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.431535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.431759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.431851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.432074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.432175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.432389 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.432481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.433301 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.433412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.433672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.433774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.433995 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.434095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.434314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.434413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.434638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.434739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.434963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.435065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.435289 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.435388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.435612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.435711 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.435928 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436363 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436669 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436898 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.436998 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.437218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.437333 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.437555 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.437651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.437882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.437975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.438206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.438307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.438515 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.438606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.438763 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:09:58.438857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.439172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.439505 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.439855 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.440174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.440522 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.440852 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.441171 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.441561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.441873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:09:58.442118 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:09:58.462118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.465003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.529215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.context [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309b8a82-e599-4304-b992-62cc90d7ef9e(cell1) {{(pid=116084) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:09:58.532076 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.context [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309b8a82-e599-4304-b992-62cc90d7ef9e(cell1) {{(pid=116083) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:09:58.533539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.535382 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.536205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.536561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.538191 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.538305 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.539015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.541350 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.551439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.552302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.553743 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.556050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.715650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:58.721621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_db.sqlalchemy.engines [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:09:59.039355 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:09:59.046327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:09:59.049997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:09:59.056629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:09:59.388261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:09:59.393489 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-ae0cc264-3274-4d74-89e8-4d3e57b91bb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:09:59.400371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563bb74429c0 pid: 116084 (default app) Dec 15 16:09:59.405361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:09:59.410872 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: WARNING keystonemiddleware.auth_token [None req-473cd477-89df-40fd-b58a-dbd02fd2d075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:09:59.416207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563bb74429c0 pid: 116083 (default app) Dec 15 16:10:34.502592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-043ed02d-f845-496e-a7bf-4f7c75fec0df tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Action: 'create', calling method: .version_select at 0x7f88ba0a2e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1190806683", "metadata": {"Type": "work"}}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:36.155890 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-043ed02d-f845-496e-a7bf-4f7c75fec0df tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.298022 Dec 15 16:10:36.156808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 16:10:32 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3301 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 16:10:36.291429 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1070849342", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "69eb36a1-1fe8-46e9-948f-c08f5a260c2b"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:36.350761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-609060746", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "7d5230c5-6fc8-45a8-89a6-a1e34f97f335"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:36.575041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] validate_networks() for [('69eb36a1-1fe8-46e9-948f-c08f5a260c2b', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:10:36.777964 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] validate_networks() for [('7d5230c5-6fc8-45a8-89a6-a1e34f97f335', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:10:38.111909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:10:38.112570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:10:38.112936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:10:38.113348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:10:38.113779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:10:38.138160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.138706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.139518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.143351 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.223154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Getting quotas for project d876e8f6e278448196f8e8989149241c. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:38.252876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Getting quotas for user d1e314d7ae7a491ab057a93961c7c3b5 and project d876e8f6e278448196f8e8989149241c. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:38.280511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:10:38.284992 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:10:38.325021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:10:38.325555 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:10:38.325980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:10:38.326968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:10:38.327623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:10:38.352695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.353352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.354965 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.355505 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.422713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f836cd4f-b67b-440a-bdf4-d947d65e5619 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.264586 Dec 15 16:10:38.429706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:10:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:10:38.439778 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:38.441285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-430e628a-bcde-41b6-9ca2-d99c60b54ec7 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Calling method '.version_select at 0x7f88b9e8c1f0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.461051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for user df09b0b78f6646ed8c520c5c46b3eb58 and project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:38.477753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:10:38.482308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:10:38.674265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b4fd79e9-1977-4395-b1fb-3408cd62722f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.209490 Dec 15 16:10:38.675002 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:10:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 3213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:10:38.690786 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c8738dd4-6f44-4b6e-b6f6-7687bb0c1606 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b9695790>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.812676 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c8738dd4-6f44-4b6e-b6f6-7687bb0c1606 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/886dd10b-d0e2-4402-9f1d-b7eceb1e7667" status: 200 len: 351 microversion: 2.1 time: 0.130645 Dec 15 16:10:38.813939 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/os-volumes/886dd10b-d0e2-4402-9f1d-b7eceb1e7667 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:38.818917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b774a5e-6eb3-4af4-b889-bb59d6bdc8fb tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.819910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8b774a5e-6eb3-4af4-b889-bb59d6bdc8fb tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:38.866610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-430e628a-bcde-41b6-9ca2-d99c60b54ec7 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536" status: 200 len: 354 microversion: 2.1 time: 0.439428 Dec 15 16:10:38.867601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536 => generated 354 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:38.893331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0f106a5-8282-46ff-9431-469e1c09c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.897767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0f106a5-8282-46ff-9431-469e1c09c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:39.103681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8b774a5e-6eb3-4af4-b889-bb59d6bdc8fb tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:39.147286 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8b774a5e-6eb3-4af4-b889-bb59d6bdc8fb tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1215 microversion: 2.1 time: 0.306638 Dec 15 16:10:39.148158 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1215 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:39.156345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-607d44dc-0f52-486d-ac6a-096679a2f2b1 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Calling method '.version_select at 0x7f88b8e29af0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:39.222480 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-607d44dc-0f52-486d-ac6a-096679a2f2b1 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536" status: 200 len: 354 microversion: 2.1 time: 0.072155 Dec 15 16:10:39.237896 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:39 2021] GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:39.244703 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bdba9a31-1c39-4ede-8227-2c43def1aef2 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Calling method '.version_select at 0x7f88b8e31d30>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:39.408297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e0f106a5-8282-46ff-9431-469e1c09c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:39.419067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bdba9a31-1c39-4ede-8227-2c43def1aef2 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536" status: 202 len: 0 microversion: 2.1 time: 0.179349 Dec 15 16:10:39.423537 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 16:10:39 2021] DELETE /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:10:39.430300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b02fb9ad-14d4-4f7a-9fd4-2d95519ca171 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Calling method '.version_select at 0x7f88b8e31f70>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:39.445072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0f106a5-8282-46ff-9431-469e1c09c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1217 microversion: 2.1 time: 0.573571 Dec 15 16:10:39.450163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1217 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:39.824902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b02fb9ad-14d4-4f7a-9fd4-2d95519ca171 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536" status: 200 len: 353 microversion: 2.1 time: 0.398789 Dec 15 16:10:39.825863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 6/10] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:39 2021] GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536 => generated 353 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:40.166765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d3a1775-50fd-436f-b5e9-784587504a13 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:40.167369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d3a1775-50fd-436f-b5e9-784587504a13 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:40.240326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d3a1775-50fd-436f-b5e9-784587504a13 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.247355 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d3a1775-50fd-436f-b5e9-784587504a13 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1215 microversion: 2.1 time: 0.084277 Dec 15 16:10:40.249507 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:40 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:40.470879 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ca19f93-5c04-4461-986e-1928bcb74aec tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:40.472426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ca19f93-5c04-4461-986e-1928bcb74aec tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:40.497840 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-996989662", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b3320d8-9e2d-410a-88f0-376dd555410c"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:40.582207 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ca19f93-5c04-4461-986e-1928bcb74aec tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.592997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ca19f93-5c04-4461-986e-1928bcb74aec tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1217 microversion: 2.1 time: 0.126366 Dec 15 16:10:40.604517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:40 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:40.621172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] validate_networks() for [('5b3320d8-9e2d-410a-88f0-376dd555410c', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:10:40.837009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-123bed86-e9d6-45c5-8981-795b9da0e2cc tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Calling method '.version_select at 0x7f88b9643a60>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:40.896102 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-123bed86-e9d6-45c5-8981-795b9da0e2cc tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536" status: 200 len: 353 microversion: 2.1 time: 0.062666 Dec 15 16:10:40.901633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:40 2021] GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:10:41.267885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:41.268853 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:41.275485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.276286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.277324 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.278013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.383313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:10:41.383738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:10:41.396050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:10:41.399460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:10:41.400951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:10:41.419989 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.420739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.421936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.423446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.434346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:41.446241 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34308c55-fd57-4f13-82ee-c137ab267d6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1219 microversion: 2.1 time: 0.182064 Dec 15 16:10:41.449861 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Getting quotas for project 9f1847fe78e7459f800877907c42878d. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:41.453859 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Getting quotas for user c7af97c50dab46dd85477944b2450a4d and project 9f1847fe78e7459f800877907c42878d. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:41.456602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 8/14] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:41 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:41.470415 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:10:41.473628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:10:41.584329 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5662ed70-dcd7-42ca-b7ec-ad13b2ec9e91 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.188079 Dec 15 16:10:41.586556 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 7/15] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:10:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:10:41.597769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b34bc65d-cb67-4605-9837-30c537b9272e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:41.598482 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b34bc65d-cb67-4605-9837-30c537b9272e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:41.616578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:41.619394 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:41.628425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.629114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.630350 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.631812 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.759320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b34bc65d-cb67-4605-9837-30c537b9272e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:41.768210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b34bc65d-cb67-4605-9837-30c537b9272e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1221 microversion: 2.1 time: 0.174769 Dec 15 16:10:41.773519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:41 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:41.898731 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1598574269", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b3320d8-9e2d-410a-88f0-376dd555410c"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:41.978009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] validate_networks() for [('5b3320d8-9e2d-410a-88f0-376dd555410c', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:10:42.078857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.118612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-85d688ee-c14c-445c-928f-c146b113ea43 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1221 microversion: 2.1 time: 0.507028 Dec 15 16:10:42.122407 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:41 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1221 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:42.142536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f14f897d-4629-4e95-8866-11589b8ab490 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Calling method '.version_select at 0x7f88b8dcaa60>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:42.268407 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-f14f897d-4629-4e95-8866-11589b8ab490 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] HTTP exception thrown: Volume 47b282a6-047f-482e-9fdb-8bcfa7f1c536 could not be found. Dec 15 16:10:42.269015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f14f897d-4629-4e95-8866-11589b8ab490 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] Returning 404 to user: Volume 47b282a6-047f-482e-9fdb-8bcfa7f1c536 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:10:42.269910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f14f897d-4629-4e95-8866-11589b8ab490 tempest-VolumesGetTestJSON-765121686 tempest-VolumesGetTestJSON-765121686-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536" status: 404 len: 109 microversion: 2.1 time: 0.141478 Dec 15 16:10:42.273544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:42 2021] GET /compute/v2.1/os-volumes/47b282a6-047f-482e-9fdb-8bcfa7f1c536 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:10:42.464618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:42.465538 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:42.480619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.509983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.511120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.511716 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.688761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.699189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-57b69849-5f5a-4f59-a66d-f528de7ea5ee tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1211 microversion: 2.1 time: 0.239463 Dec 15 16:10:42.703894 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:42 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:42.819565 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:10:42.820011 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:10:42.820447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:10:42.820855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:10:42.821269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:10:42.850653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.851180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.857851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.858424 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.917905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6301fddf-e9f3-4c48-b8e8-5b6e30add0e6 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d5eca0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:42.948702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Getting quotas for project 9f1847fe78e7459f800877907c42878d. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:42.967118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Getting quotas for user c7af97c50dab46dd85477944b2450a4d and project 9f1847fe78e7459f800877907c42878d. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:43.001374 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:10:43.016300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:10:43.030696 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6301fddf-e9f3-4c48-b8e8-5b6e30add0e6 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a8a6fe98-75e6-42a7-9046-4415d4be0dd4" status: 200 len: 351 microversion: 2.1 time: 0.116879 Dec 15 16:10:43.032106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:42 2021] GET /compute/v2.1/os-volumes/a8a6fe98-75e6-42a7-9046-4415d4be0dd4 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:10:43.135779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-700ba0d6-897d-45b8-bc69-938a09dffc70 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.241933 Dec 15 16:10:43.138615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 10/21] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:10:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:10:43.143434 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:43.143434 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:43.153348 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.154448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34fc9b69-774c-405b-bbfd-66d8437c394f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:43.155550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.158169 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.158548 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34fc9b69-774c-405b-bbfd-66d8437c394f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:43.159854 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.328580 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34fc9b69-774c-405b-bbfd-66d8437c394f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.341564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34fc9b69-774c-405b-bbfd-66d8437c394f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1222 microversion: 2.1 time: 0.190720 Dec 15 16:10:43.367782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:43 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:43.437702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.465623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b303fad6-2715-418a-ae97-572c2b301b31 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1213 microversion: 2.1 time: 0.331699 Dec 15 16:10:43.467003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:43 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1213 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:43.731515 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:43.732159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:43.760626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.765453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.773591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.775169 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.093663 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.106884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d1f2a4f6-7337-4def-903b-544a34f575ce tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1267 microversion: 2.1 time: 0.389364 Dec 15 16:10:44.111132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:43 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:44.364866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:44.364866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:44.369805 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.370255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.371623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.372400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.482396 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:44.483025 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:44.495884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.504211 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.506363 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.507607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.643375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.651565 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-43db9868-2bb0-45bf-993c-ba427a84cbbd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1226 microversion: 2.1 time: 0.295264 Dec 15 16:10:44.663232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:44 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1226 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:44.931111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.941449 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e10b4641-fbc7-4d97-8c59-fc1744716f24 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1269 microversion: 2.1 time: 0.461575 Dec 15 16:10:44.946239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:44 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1269 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:45.127693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:45.128465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:45.141112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.141697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.148338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.151814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.448814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dcda5193-216a-4d65-b761-e479a2fffb5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'create', calling method: .version_select at 0x7f88b8d72670>, body: {"keypair": {"name": "tempest-keypair-1600518795"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:45.489974 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-dcda5193-216a-4d65-b761-e479a2fffb5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:45.496700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-dcda5193-216a-4d65-b761-e479a2fffb5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for user 2b01ba54246a4e8482417367b6329c1a and project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:46.150588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:46.162114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1e2c2201-14f6-44b8-9691-99db7e5935c2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1273 microversion: 2.1 time: 1.038300 Dec 15 16:10:46.168994 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:45 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1273 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:46.182374 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-599ba97e-ef04-4127-b674-8c4a66303a21 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d22f70>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:46.365652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-599ba97e-ef04-4127-b674-8c4a66303a21 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/01ebd970-a9f4-4d08-b294-5692db0076b2" status: 200 len: 350 microversion: 2.1 time: 0.195170 Dec 15 16:10:46.367471 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:10:46 2021] GET /compute/v2.1/os-volumes/01ebd970-a9f4-4d08-b294-5692db0076b2 => generated 350 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:46.373108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:46.374013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:46.402612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:46.403082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:46.404125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:46.408120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:46.531064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-dcda5193-216a-4d65-b761-e479a2fffb5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:46.559711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-dcda5193-216a-4d65-b761-e479a2fffb5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for user 2b01ba54246a4e8482417367b6329c1a and project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:46.640463 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dcda5193-216a-4d65-b761-e479a2fffb5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.975943 Dec 15 16:10:46.646812 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 14/29] 10.222.0.36 () {62 vars in 1198 bytes} [Wed Dec 15 16:10:44 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1978 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:10:46.660701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:46.673596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:46.703599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:46.710676 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:46.711967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:46.713522 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.067551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.090540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-be565852-6f65-400a-b297-5875d7e404f0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1274 microversion: 2.1 time: 0.714281 Dec 15 16:10:47.092179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 16/30] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:46 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1274 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:47.112810 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b768fbf1-b605-44ce-adb1-d5491187a368 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d22040>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:47.154178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.163237 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5ff5ada0-05bb-4ac7-a7f6-4d178c5d8da1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1275 microversion: 2.1 time: 0.519983 Dec 15 16:10:47.198075 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 15/31] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:46 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1275 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:47.218102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:47.223304 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:47.261359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:47.261883 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.262910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:47.263647 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.448604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b768fbf1-b605-44ce-adb1-d5491187a368 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.354450 Dec 15 16:10:47.449257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 17/32] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:47.463624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f786d7b4-14d1-4667-ab74-17eb2987728d tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8daaf70>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:47.609649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.633506 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1a0e3062-2d2c-444c-9b26-5b48c4c1a449 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1273 microversion: 2.1 time: 0.429056 Dec 15 16:10:47.634757 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 16/33] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1273 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:47.768399 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f786d7b4-14d1-4667-ab74-17eb2987728d tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.299018 Dec 15 16:10:47.770536 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1148 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:10:47.782898 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-59045f25-53cb-420d-b012-ae7b1bae748f tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b84d8e50>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.108432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.109322 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:48.127099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.127555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.128360 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.128791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.239290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-59045f25-53cb-420d-b012-ae7b1bae748f tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.459875 Dec 15 16:10:48.240611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:48.247025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.251882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:48.274259 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.276760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.278504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.283237 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.513450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.528834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1eae4c6c-89db-49f0-a092-994d9001a6c1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1280 microversion: 2.1 time: 0.420936 Dec 15 16:10:48.543239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 19/36] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1280 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:48.558754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-11f1340a-ad16-4650-88d1-73dcfb10d3e2 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d73790>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.671735 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.689992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-df006574-994e-43df-a7fe-8bde8b50d066 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1275 microversion: 2.1 time: 0.447344 Dec 15 16:10:48.703139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 18/37] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1275 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:48.720416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.721458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:48.747367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.749260 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.755667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.760033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.785354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-11f1340a-ad16-4650-88d1-73dcfb10d3e2 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.240314 Dec 15 16:10:48.786777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 20/38] 10.222.0.36 () {58 vars in 1166 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:48.801150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4423f05e-03fb-4eae-af8d-ec2a53203d08 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d22ca0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.985623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4423f05e-03fb-4eae-af8d-ec2a53203d08 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.189035 Dec 15 16:10:48.994222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1169 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:10:49.011630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-483bc274-4d8d-48c3-a521-1c16ded37b82 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d88940>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.211497 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-483bc274-4d8d-48c3-a521-1c16ded37b82 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.212988 Dec 15 16:10:49.220189 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:49.225546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4fb1787a-6883-4a93-b688-3a91908f2ced tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d889d0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.451556 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4fb1787a-6883-4a93-b688-3a91908f2ced tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.230162 Dec 15 16:10:49.452203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 23/41] 10.222.0.36 () {58 vars in 1187 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:49.467202 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b8e2905a-9a8f-4e90-b1a7-6cb4258f0122 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] Calling method '.version_select at 0x7f88b8d22af0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.600704 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:49.610606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c418f4c-17c4-4881-85e4-afd2958fcc2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1273 microversion: 2.1 time: 0.905916 Dec 15 16:10:49.611739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 19/42] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1273 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:49.632105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.635703 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:49.670572 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.672028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.679932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.689782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.892010 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b8e2905a-9a8f-4e90-b1a7-6cb4258f0122 tempest-VolumesTestJSON-627319575 tempest-VolumesTestJSON-627319575-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.430391 Dec 15 16:10:49.892604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 24/43] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:49.911368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.912873 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:49.954350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.954856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.955767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.956213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.030607 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.046814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e14f0a17-3f69-465d-ac70-9109088c6c3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1280 microversion: 2.1 time: 0.433726 Dec 15 16:10:50.048843 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 20/44] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1280 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:50.524116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.543501 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f8a50e58-75f4-45b9-a9ec-deb28c404141 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.635899 Dec 15 16:10:50.554470 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 25/45] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:50.627872 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:50.628827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:50.638745 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.644022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.647213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.648322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.071648 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:51.076480 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:51.079372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:51.097470 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.098408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-271bf4e1-b7cb-43aa-92e0-ee6d2315ca15 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.471313 Dec 15 16:10:51.101688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 21/46] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:50 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:51.109850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.109850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.109850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.567320 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:51.572448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:51.581760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.584837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.586747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.588715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:52.895218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:52.906271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-048316ea-11f7-412d-b977-7af81adf0141 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 1.840578 Dec 15 16:10:52.938310 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 26/47] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:51 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:52.949715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:52.950345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:52.974418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:52.974867 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:52.975660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:52.981204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.628670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.650354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f969c41c-56a6-4f5d-87cd-c7156142c95e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 2.093698 Dec 15 16:10:53.667573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 22/48] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:51 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:53.719737 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.729450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b79a0ab6-46eb-4aaf-a2dc-7505fd2e385f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.789800 Dec 15 16:10:53.742834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 27/49] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:52 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:53.932322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:53.933162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:53.940393 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:53.940848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.941701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:53.942148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:54.686509 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:54.688736 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:54.712296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:54.714815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:54.715766 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:54.716217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.085336 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.096077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8b6c5d8f-36b6-4c7e-8ee7-9b23cd6b5158 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 1.167614 Dec 15 16:10:55.104600 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 23/50] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:53 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:55.119875 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:55.120516 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:55.137026 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.137727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.138699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.140764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.938700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.949045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b8dd770f-3a40-4e2c-ac0f-17044baaf7d9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 1.266177 Dec 15 16:10:55.950274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 28/51] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:54 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:55.989114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-422499090", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed985f33-cdae-44a4-bb97-f437877d64c9"}], "security_groups": [{"name": "tempest-securitygroup--910418788"}], "key_name": "tempest-keypair-1600518795", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:56.162801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.171943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-12526df0-33d8-47f0-902a-c3f746e1ac5a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 1.066189 Dec 15 16:10:56.187514 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 24/52] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:55 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:56.397523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-48754b8e-f38b-46e5-9efe-e0904e4476a7 req-2ceb4f3e-783c-4594-acd2-e55f5909a625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd5f486-3302-4f15-ba29-0a1734919fcb", "tag": "648d6170-f09f-415c-8e88-60e67684a8da"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:56.400100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:56.400100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:10:56.421123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-48754b8e-f38b-46e5-9efe-e0904e4476a7 req-2ceb4f3e-783c-4594-acd2-e55f5909a625 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.426865 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-48754b8e-f38b-46e5-9efe-e0904e4476a7 req-2ceb4f3e-783c-4594-acd2-e55f5909a625 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.435024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] validate_networks() for [('ed985f33-cdae-44a4-bb97-f437877d64c9', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:10:56.472410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-48754b8e-f38b-46e5-9efe-e0904e4476a7 req-2ceb4f3e-783c-4594-acd2-e55f5909a625 service nova] Creating event network-changed:648d6170-f09f-415c-8e88-60e67684a8da for instance cdd5f486-3302-4f15-ba29-0a1734919fcb on hv-cinder-80070 Dec 15 16:10:56.473925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-48754b8e-f38b-46e5-9efe-e0904e4476a7 req-2ceb4f3e-783c-4594-acd2-e55f5909a625 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:10:56.475169 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.475623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.476444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.476884 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.498969 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.compute.rpcapi [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:10:56.500175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=116083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:10:56.570211 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-50add43d-bd84-4392-ad48-10ed21a4b5a1 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381316 Dec 15 16:10:56.570823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 25/53] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:56.576157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:56.577210 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:56.589271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.592490 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.593358 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.593837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.865040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.903178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8c042a86-e6bf-4c34-810b-ff9b7ed87543 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.309009 Dec 15 16:10:56.905162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 26/54] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:56 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:57.147826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-d175339b-b1ad-47e1-9b8d-c2834b6a56a5 req-779e4c9d-66de-412d-89b4-3b8b8634eea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f52daeb-72c4-4375-a19f-7bad854fba4d", "tag": "dcc16873-43c3-4ab9-a1c5-a436ca059a16"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:57.154239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:57.154239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:10:57.166207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-d175339b-b1ad-47e1-9b8d-c2834b6a56a5 req-779e4c9d-66de-412d-89b4-3b8b8634eea9 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.170276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-d175339b-b1ad-47e1-9b8d-c2834b6a56a5 req-779e4c9d-66de-412d-89b4-3b8b8634eea9 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.198321 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-d175339b-b1ad-47e1-9b8d-c2834b6a56a5 req-779e4c9d-66de-412d-89b4-3b8b8634eea9 service nova] Creating event network-changed:dcc16873-43c3-4ab9-a1c5-a436ca059a16 for instance 4f52daeb-72c4-4375-a19f-7bad854fba4d on hv-cinder-80070 Dec 15 16:10:57.215311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-d175339b-b1ad-47e1-9b8d-c2834b6a56a5 req-779e4c9d-66de-412d-89b4-3b8b8634eea9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308581 Dec 15 16:10:57.222337 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 27/55] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:57.228087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.245468 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.278577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.279295 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.283836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.284499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.597066 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:10:57.598231 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:10:57.598864 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:10:57.599432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:10:57.600065 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:10:57.614604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.615128 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.615951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.616384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.639431 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for project 4293903670af4a238fe13d805fcd9d59. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:10:57.644071 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for user 2b01ba54246a4e8482417367b6329c1a and project 4293903670af4a238fe13d805fcd9d59. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:10:57.666945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:10:57.668935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:10:57.677934 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.689593 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-19c22b6d-13a7-46a3-a6a2-d26e45b2096b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.465747 Dec 15 16:10:57.691997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 28/56] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:57.698564 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.702325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.717717 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.718524 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.722343 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.735161 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.772550 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fd46ba23-5b29-4083-b2c2-e19bac1cba49 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.820331 Dec 15 16:10:57.774087 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 29/57] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Dec 15 16:10:55 2021] POST /compute/v2.1/servers => generated 401 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:10:57.786051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ced6b3f-ddfa-43c6-92be-613e0535d362 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.786994 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ced6b3f-ddfa-43c6-92be-613e0535d362 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.927110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4ced6b3f-ddfa-43c6-92be-613e0535d362 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.941519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4ced6b3f-ddfa-43c6-92be-613e0535d362 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.947610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4ced6b3f-ddfa-43c6-92be-613e0535d362 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.948905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ced6b3f-ddfa-43c6-92be-613e0535d362 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1281 microversion: 2.20 time: 0.168078 Dec 15 16:10:57.950115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 30/58] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:57.960221 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.960221 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.971812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.972264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.973059 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.973523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.003332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:58.011633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4cd236df-56dc-4dc8-8a55-e29a167d343a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.318394 Dec 15 16:10:58.012226 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:58.159063 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:58.168856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c3e9fb87-8249-4c44-acf7-81cbf5a3ead2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.217333 Dec 15 16:10:58.169740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 31/60] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:58.589456 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-3739374a-8eee-47a3-9050-8ea0c1e6724a req-2105b32f-3b39-4bb4-afd7-79de196545e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d69eb5-4a68-41bb-9246-0cb932ad79d8", "tag": "74e0a314-8c6c-4c1c-94b0-01a8822e91d5"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:58.590987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:58.590987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:10:58.598072 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-3739374a-8eee-47a3-9050-8ea0c1e6724a req-2105b32f-3b39-4bb4-afd7-79de196545e7 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.598767 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-3739374a-8eee-47a3-9050-8ea0c1e6724a req-2105b32f-3b39-4bb4-afd7-79de196545e7 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.615677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-3739374a-8eee-47a3-9050-8ea0c1e6724a req-2105b32f-3b39-4bb4-afd7-79de196545e7 service nova] Creating event network-changed:74e0a314-8c6c-4c1c-94b0-01a8822e91d5 for instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 on hv-cinder-80070 Dec 15 16:10:58.622613 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-3739374a-8eee-47a3-9050-8ea0c1e6724a req-2105b32f-3b39-4bb4-afd7-79de196545e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036293 Dec 15 16:10:58.623890 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 30/61] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:58.710123 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:58.710123 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:58.730076 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.730993 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.732345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.733253 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.969407 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:58.970201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:58.981693 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.982960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.985370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.985854 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.217945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.227822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-edc38f4f-e04e-452a-8b91-61cddcc769a3 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.523341 Dec 15 16:10:59.228419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 32/62] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:58 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:59.242124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:59.242735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:59.258540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.259142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.259962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.260402 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.412020 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.428889 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.432591 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.434206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-92f3b7c1-75d1-42e6-a7c1-e838444df66d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1285 microversion: 2.20 time: 0.469350 Dec 15 16:10:59.435464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 31/63] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:58 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1285 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:59.450183 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:59.452687 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:59.458926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.460847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.462463 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.463119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.935507 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.945243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ead8de4b-1a6f-4a50-8414-af257f31dcf2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.711576 Dec 15 16:10:59.946319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 33/64] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:59 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:59.978506 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-b92d99eb-cdd7-44c9-bae2-a7027cfeb015 req-7d1a040e-accc-48d9-a54a-6d74258b6fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50", "tag": "fdd65e26-501b-4251-b404-78bc05ad4f44"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:59.983522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:59.983522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:11:00.007111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b92d99eb-cdd7-44c9-bae2-a7027cfeb015 req-7d1a040e-accc-48d9-a54a-6d74258b6fe3 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.009098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b92d99eb-cdd7-44c9-bae2-a7027cfeb015 req-7d1a040e-accc-48d9-a54a-6d74258b6fe3 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.064285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-b92d99eb-cdd7-44c9-bae2-a7027cfeb015 req-7d1a040e-accc-48d9-a54a-6d74258b6fe3 service nova] Creating event network-changed:fdd65e26-501b-4251-b404-78bc05ad4f44 for instance f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 on hv-cinder-80070 Dec 15 16:11:00.064877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b92d99eb-cdd7-44c9-bae2-a7027cfeb015 req-7d1a040e-accc-48d9-a54a-6d74258b6fe3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:11:00.066114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.066561 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.067367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.067797 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.101339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.compute.rpcapi [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:11:00.108908 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] Releasing lock "compute-rpcapi-router" {{(pid=116084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:11:00.151116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-26314d71-8f25-4621-b7f1-f0a72d377969 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203103 Dec 15 16:11:00.152365 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 34/65] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:00.198895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.206743 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1d05614b-9317-478e-bbdf-89980268c99e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.769691 Dec 15 16:11:00.207348 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:59 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:00.245293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:00.246058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:00.258199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.258759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.263651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.263651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.454087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:00.457251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:00.467160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.468016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.469935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.470779 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.621740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.629927 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.632007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.633118 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-91b7f000-ea32-469a-8654-482246384bfb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1339 microversion: 2.20 time: 0.183799 Dec 15 16:11:00.644855 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:00 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:00.964067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:00.965066 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:00.974650 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.975549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.978046 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.979121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.982008 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.006787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-95f419b8-a4b6-491d-b9ac-d237f1eced8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.766248 Dec 15 16:11:01.011003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 35/68] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:00 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:01.225870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:01.226905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:01.236698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.237419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.244424 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.245460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.880102 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.890134 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-94319bb2-3054-4e49-98e1-c625c58650be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.669506 Dec 15 16:11:01.895752 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 36/69] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:01 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:01.905804 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:01.906588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:01.919341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.919793 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.920595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.921028 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.035360 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.048100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.050279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.052523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.054111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8929193e-d66c-4781-97cf-a4e056b822f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1339 microversion: 2.20 time: 0.157103 Dec 15 16:11:02.055012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 37/70] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:01 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:02.061021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:02.061943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:02.067145 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-30a8d506-d4c5-4ce9-a4ca-6b6ddcc6bb6c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 1.108654 Dec 15 16:11:02.068167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 34/71] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:00 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:02.073781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.074255 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.075172 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.075607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.228534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.236152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d57b5556-7c4a-44dd-9131-f8a93c73edf9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.179417 Dec 15 16:11:02.236730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 38/72] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:02 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:02.906627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:02.907239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:02.914117 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.915006 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.916313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.916949 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.080891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.082054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.106313 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.110200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.111280 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.111876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.185123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.201938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-939d5e1b-d724-4b88-80bc-4eb8463fe6e4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.298186 Dec 15 16:11:03.208955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 35/73] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:02 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:03.224138 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.232995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.240092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.240539 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.250777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.251561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.314815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.323800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.325539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.327198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f99bd973-311c-4524-8bbd-042a27ff7aeb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.258751 Dec 15 16:11:03.338914 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 39/74] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:03 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:03.344132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.344953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.351079 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.351825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.353299 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.354005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.547004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.558438 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7216c4c6-edf0-46ca-a236-3e7ddcf95c51 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.348243 Dec 15 16:11:03.559023 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 36/75] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:03 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:03.582664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.594144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3a0d0560-451f-403d-9a45-eb1206db5443 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.253870 Dec 15 16:11:03.595903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 40/76] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:03 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:04.267896 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:04.269266 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:04.283586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.284228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.285380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.286075 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.348771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:04.350154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:04.361106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.361717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.362657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.363179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.510210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.520496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.522062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.523170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-78da70ae-05d7-4345-8fa1-3cae6974ddbf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.181023 Dec 15 16:11:04.523732 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 41/77] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:04 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:04.576023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:04.576629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:04.582936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.583384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.584199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.584722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.659070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.669567 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1bfa2907-1730-41ee-a812-a926ed084487 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.404428 Dec 15 16:11:04.677439 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 37/78] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:04 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:04.678372 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:04.684011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:04.690075 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.690521 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.691640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.692211 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.823291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.831182 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb9905da-d913-455b-9670-db2c5653e2bc tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.258888 Dec 15 16:11:04.842047 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 42/79] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:04 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:04.918446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.926777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bc4aa37a-6ced-41f7-987d-79e2abf5c17e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.252569 Dec 15 16:11:04.927630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 38/80] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:04 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:05.543901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.545351 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.552311 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.552874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.553895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.554473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.696324 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.697142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.705133 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.705133 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.705943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.706366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.865755 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:05.877144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:05.879508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:05.880664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d653ee0d-7a32-41cf-902d-fbda4b2c8977 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.342181 Dec 15 16:11:05.881218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 43/81] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:05.893855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.894655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.901373 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.901854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.902648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.903252 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.143203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.151083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-934b431c-92c0-467b-a2a4-b59fa5529660 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.268647 Dec 15 16:11:06.151675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 44/82] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:06.159627 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:06.159627 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:06.162987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.163438 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.165279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.165739 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.219968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.228109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-77a3c5bd-594d-41b7-ac08-0cd9d1b753d7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.541806 Dec 15 16:11:06.228740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 39/83] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:06.330376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.339674 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9e0da27e-ea86-42c9-8c5d-a6534db9933b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.187004 Dec 15 16:11:06.340388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 45/84] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:06 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:06.414261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-f8124d69-d05f-424e-afc4-8da53c262795 req-7712fffd-8534-4a05-9ec0-30a31c9ff0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:06.417274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:06.417274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:11:06.423981 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f8124d69-d05f-424e-afc4-8da53c262795 req-7712fffd-8534-4a05-9ec0-30a31c9ff0ba service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.424414 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f8124d69-d05f-424e-afc4-8da53c262795 req-7712fffd-8534-4a05-9ec0-30a31c9ff0ba service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.443897 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-f8124d69-d05f-424e-afc4-8da53c262795 req-7712fffd-8534-4a05-9ec0-30a31c9ff0ba service nova] Creating event network-changed:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:11:06.449514 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-f8124d69-d05f-424e-afc4-8da53c262795 req-7712fffd-8534-4a05-9ec0-30a31c9ff0ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038691 Dec 15 16:11:06.450530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 40/85] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:06.899426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:06.900393 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:06.906702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.907282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.908694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.909240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.041699 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.050336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.052266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.053361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2b0cbd05-852d-4f57-8b7c-da1018197477 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.158003 Dec 15 16:11:07.054075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 46/86] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:06 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:07.168726 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.169483 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.175416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.175862 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.176640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.177074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.244263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.244953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.250939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.251386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.252192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.252614 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.328635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.336032 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6c008e05-bd0b-450c-b83c-9373c1d38f90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.171780 Dec 15 16:11:07.337056 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 41/87] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:07.356529 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.357250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.363350 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.363791 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.364738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.365173 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.391715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.400977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cdf25ff3-ed64-487f-bcd5-03b72fc64fd5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.160904 Dec 15 16:11:07.401816 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 47/88] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:07.511429 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.518679 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-00e3924d-0031-4722-93cf-b48437074f01 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.166561 Dec 15 16:11:07.519233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 42/89] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:08.072076 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:08.072790 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:08.078767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.079215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.080009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.080441 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.268031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.280765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.294075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.296801 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2d59d3df-d4ce-4f2f-8a4c-14a5ce5fb5cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.228561 Dec 15 16:11:08.311103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 48/90] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:08 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:08.352931 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:08.354287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:08.362362 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.363078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.365077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.365895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.420265 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:08.421734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:08.429718 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.431855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.435487 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.438476 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.600138 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.611199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6e15445b-fb43-49f2-bd24-cb362a771d2c tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.259225 Dec 15 16:11:08.612276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 43/91] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:08 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:08.618347 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:08.619431 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:08.626745 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.627393 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.628809 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.629838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.645069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.654672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d3b779cf-38a9-4971-9a11-9198435604ba tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.239564 Dec 15 16:11:08.655608 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 49/92] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:08 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:08.892274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.901867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d24cac2e-f000-40c7-8a45-9c6b7009838f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.288354 Dec 15 16:11:08.902536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 44/93] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:08 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:09.317174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.318465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.326907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.331412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.334833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.335488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.569172 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.578745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.580983 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.582408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-33c5c2ce-1dde-494e-8449-b249e217fa7d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.269793 Dec 15 16:11:09.594719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 50/94] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:09.628295 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.629805 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.637482 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.638349 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.639437 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.640793 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.672229 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.673246 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.682084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.682729 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.683786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.684657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.824422 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.832145 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7d372f99-861f-4cf2-a66a-a3dcc0194abe tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.207842 Dec 15 16:11:09.832733 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 45/95] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:09.873015 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.880577 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-039d76c2-613d-41f1-9026-8df196f576d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.212642 Dec 15 16:11:09.881155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 51/96] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:09.920121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.920733 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.926906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.927358 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.928146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.928579 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.071881 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.082484 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1007a239-957a-45bb-96c9-343359603e4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.166350 Dec 15 16:11:10.083568 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 46/97] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:10.610858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:10.616238 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:10.628024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.632078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.632981 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.634289 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.772769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.781100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.782879 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.783973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e388ecfb-3943-4690-82c9-f89666de7cf1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.185910 Dec 15 16:11:10.784551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 52/98] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:10 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:10.849568 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:10.850402 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:10.856128 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.856573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.857347 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.857807 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.901841 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:10.902455 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:10.908695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.909335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.910307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.910743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.995718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.003231 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2aae1b50-56c8-4820-946e-5bd944a0bc0f tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.157234 Dec 15 16:11:11.003921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 47/99] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:10 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:11.049598 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.057659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8b4c6a84-ef6f-4305-9201-f49757d8b4ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.160611 Dec 15 16:11:11.058436 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 53/100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:10 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:11.099822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.100425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.106818 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.107275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.108049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.108474 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.236980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.244861 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5307213a-a7a9-4e29-b5d8-7573b0f99a7b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.149068 Dec 15 16:11:11.245439 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 48/101] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:11 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:11.801345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.802096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.808364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.808807 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.809602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.810054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.942467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.950216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.951791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.952988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4c0fd13-ab9b-4eb9-aa98-55765f9324db tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.155434 Dec 15 16:11:11.953646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 54/102] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:11 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:12.021301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.021986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.028503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.028950 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.029760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.030186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.074975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.075594 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.081590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.082047 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.082838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.083274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.171422 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:12.179244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-632c3bf5-b898-42d2-8927-c0c0ef160804 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.161549 Dec 15 16:11:12.179812 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 49/103] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:12.261749 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.262356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.268608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.269050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.269856 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.270458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.404107 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:12.411622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef0222f1-b8ca-45ef-bedb-c8ab8e579b10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.341032 Dec 15 16:11:12.413713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 55/104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:12.422130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:12.429359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4928fb3e-7b01-46ee-90b5-a4e9e371e8e4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.171658 Dec 15 16:11:12.429941 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 50/105] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:12.972032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.972668 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.979880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.980386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.981209 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.981749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.116426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:13.125403 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:13.126850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:13.127961 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-122d4d9d-76aa-4bb8-a20d-1b51cd070f05 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.159690 Dec 15 16:11:13.128517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 56/106] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:13.196449 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:13.197066 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:13.202846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.203285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.204059 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.204552 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.342432 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:13.349646 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a1721de8-9dbd-45af-8b5b-5cc3f7b9482a tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.157233 Dec 15 16:11:13.350351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 51/107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:13 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:13.428017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:13.428628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:13.434693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.435136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.436088 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.436667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.448517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:13.449123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:13.455783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.456283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.457522 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.457939 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.587032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:13.594717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1300b8c9-9744-41cd-ae31-6f5c3226bc16 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.170351 Dec 15 16:11:13.604188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 57/108] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:13 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:13.622202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:13.633064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-820863d4-8981-486d-b9c3-81daa9087f7c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.187607 Dec 15 16:11:13.633979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 52/109] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:13 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:14.145754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:14.146365 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:14.156646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.157176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.158311 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.158805 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.310580 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.318908 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.320477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.322296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f93a0552-c331-4377-8bda-e98a5c5a0c42 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.180491 Dec 15 16:11:14.323030 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 58/110] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:14 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:14.366391 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:14.367094 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:14.377889 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.378720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.380132 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.380948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.531820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.540399 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b57a05d2-05de-41f8-a699-9672993ffa90 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.176859 Dec 15 16:11:14.541097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 53/111] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:14 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:14.611837 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:14.612416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:14.619239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.619682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.620745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.621263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.651231 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:14.651839 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:14.659452 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.659892 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.661087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:14.661087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:14.781493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.790929 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-74e9d78c-ffb7-4564-b166-b0966986823e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.182838 Dec 15 16:11:14.791507 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 59/112] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:14 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:14.807920 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.815604 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dd3825e0-2d52-45e6-9b04-148b2c67768b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.168438 Dec 15 16:11:14.816347 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 54/113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:14 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:15.340944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:15.341583 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:15.347672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.348117 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.349098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.349564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.490275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:15.498922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:15.500617 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:15.501759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-01d42251-85cc-4221-9b84-01bd82a154c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.165283 Dec 15 16:11:15.502771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 60/114] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:15 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:15.561160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:15.562390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:15.573451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.573451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.574064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.574582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.719312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:15.729616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b9c0579e-aeaf-4f4d-a9ce-3c3724c044de tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.172400 Dec 15 16:11:15.733821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 55/115] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:15 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:15.815102 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:15.815697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:15.821741 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.822180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.822960 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.823630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.832192 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:15.833002 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:15.840439 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.840887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.841703 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.842139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.005240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.017005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dc7e5ca5-ea30-4c59-97a5-71821d1260be tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.204626 Dec 15 16:11:16.018215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 61/116] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:15 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:16.075799 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.085214 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3710282c-7761-4e9b-be35-26410aa42176 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.256858 Dec 15 16:11:16.086181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 56/117] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:15 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:16.235117 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c9338ab8-0336-4b36-be59-5b1a24962aaf req-14297278-0229-4f32-b005-33da3cd41076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50", "name": "network-vif-plugged", "status": "completed", "tag": "fdd65e26-501b-4251-b404-78bc05ad4f44"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:16.236720 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:16.236720 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:11:16.244297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c9338ab8-0336-4b36-be59-5b1a24962aaf req-14297278-0229-4f32-b005-33da3cd41076 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.244800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c9338ab8-0336-4b36-be59-5b1a24962aaf req-14297278-0229-4f32-b005-33da3cd41076 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.257043 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c9338ab8-0336-4b36-be59-5b1a24962aaf req-14297278-0229-4f32-b005-33da3cd41076 service nova] Creating event network-vif-plugged:fdd65e26-501b-4251-b404-78bc05ad4f44 for instance f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 on hv-cinder-80070 Dec 15 16:11:16.265071 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c9338ab8-0336-4b36-be59-5b1a24962aaf req-14297278-0229-4f32-b005-33da3cd41076 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244915 Dec 15 16:11:16.266016 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 62/118] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:16.520775 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:16.521411 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:16.527574 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.528116 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.528919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.529346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.660790 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.669507 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.670993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.672086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-98d50d32-d75b-4164-992b-c9994a2033cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.155172 Dec 15 16:11:16.672646 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 57/119] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:16 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:16.746984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:16.747679 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:16.753993 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.754441 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.755218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.755649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.893196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.901110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a6966e28-a99c-42e0-bf33-f208560489b6 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.158564 Dec 15 16:11:16.901711 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 63/120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:16 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:17.035145 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.035841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:17.046806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.047249 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.048064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.048625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.101429 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.102223 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:17.112393 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.113125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.114267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.114700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.187866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.195375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8e43c66-7187-4027-b08b-d2c9dcae2ea3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.164178 Dec 15 16:11:17.201416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 58/121] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:17.247734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.254928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb82c7cd-8b1f-4e30-b2e0-d51dd87b42f0 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.157132 Dec 15 16:11:17.255492 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 64/122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:17.691962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.692917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:17.700609 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.701369 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.702278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.702761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.846495 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.855172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.856670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.857838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4a051d91-d48f-4031-b562-70a649634374 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.170262 Dec 15 16:11:17.858398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 59/123] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:17.918001 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.918606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:17.924412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.924854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.925666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.926113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.065277 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:18.072613 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe5f3a91-0f56-48c6-bc21-764857d63faa tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.158372 Dec 15 16:11:18.073186 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 65/124] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:18.217984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.218735 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:18.224550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.224989 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.225797 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.226225 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.271878 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.272615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:18.279594 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.280108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.280912 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.281333 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.373036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:18.381119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b1c7c5a5-6e66-49bc-b26f-519e5dc62c4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.166632 Dec 15 16:11:18.381740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 60/125] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:18.394469 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-e122fafd-9d29-48f6-8b65-d774d8769052 req-731c062d-cd00-4f60-a982-9b1e7777cbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd5f486-3302-4f15-ba29-0a1734919fcb", "name": "network-vif-plugged", "status": "completed", "tag": "648d6170-f09f-415c-8e88-60e67684a8da"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:18.396299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:18.396299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:11:18.404287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-e122fafd-9d29-48f6-8b65-d774d8769052 req-731c062d-cd00-4f60-a982-9b1e7777cbed service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.404731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-e122fafd-9d29-48f6-8b65-d774d8769052 req-731c062d-cd00-4f60-a982-9b1e7777cbed service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.417472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-e122fafd-9d29-48f6-8b65-d774d8769052 req-731c062d-cd00-4f60-a982-9b1e7777cbed service nova] Creating event network-vif-plugged:648d6170-f09f-415c-8e88-60e67684a8da for instance cdd5f486-3302-4f15-ba29-0a1734919fcb on hv-cinder-80070 Dec 15 16:11:18.421336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:18.423292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-e122fafd-9d29-48f6-8b65-d774d8769052 req-731c062d-cd00-4f60-a982-9b1e7777cbed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040265 Dec 15 16:11:18.424229 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 61/126] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:18.436994 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34ffaeff-42ff-41b8-a220-b5687a223cf2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.168301 Dec 15 16:11:18.439302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 66/127] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:18.878951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.879650 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:18.887057 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.887688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.888649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.889511 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.023227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:19.031352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:19.033107 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:19.034231 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-303277f5-9ec3-4618-bd79-73782a4f023f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.160176 Dec 15 16:11:19.034783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 62/128] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:19.089874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.090511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:19.096431 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.096875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.097680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.098111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.229014 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:19.236384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f6ab2273-282b-43ea-ba06-72cb87f487f5 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.150682 Dec 15 16:11:19.236944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 67/129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.398275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.399104 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:19.405278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.405839 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.406685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.407198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.455682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.456280 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:19.463348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.464096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.465072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.465610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.547348 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:19.556224 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6ead898d-d189-4a05-a870-375d3a60a7d2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.161617 Dec 15 16:11:19.561938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 63/130] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.621897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:19.628907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-54f2fa85-4974-4d77-af7a-c3595231b234 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.176839 Dec 15 16:11:19.629484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 68/131] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:20.052154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:20.053467 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:20.064038 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.064827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.065782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.066346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.239198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.247637 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.249460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.250855 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d26ba573-b5b5-4c08-b0ea-88eb468982b7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.202883 Dec 15 16:11:20.251414 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 64/132] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:20 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:20.253622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:20.254237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:20.260833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.261632 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.262287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.262813 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.412402 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.421095 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c5f5b49-9faa-4c0a-bda2-3094befbf091 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.170832 Dec 15 16:11:20.421963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 69/133] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:20 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:20.578099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:20.578875 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:20.584715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.585165 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.586217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.587269 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.645660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:20.647338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:20.653358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.653839 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.654599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:20.655025 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.782610 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.791265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dfa5b196-1e7a-4d11-98de-44af01277d65 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.216924 Dec 15 16:11:20.791842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.791979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 65/134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:20 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:20.799693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4b08aa54-dd39-45d3-b7e8-49d54a59c025 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.157653 Dec 15 16:11:20.804181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 70/135] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:20 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:21.256838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-165c45d6-f746-4547-a013-ddd741b5dad4 req-83d40571-2aba-41f2-8f60-522fc10746a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d69eb5-4a68-41bb-9246-0cb932ad79d8", "name": "network-vif-plugged", "status": "completed", "tag": "74e0a314-8c6c-4c1c-94b0-01a8822e91d5"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:21.258838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:21.258838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:11:21.266749 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-165c45d6-f746-4547-a013-ddd741b5dad4 req-83d40571-2aba-41f2-8f60-522fc10746a3 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.267316 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-165c45d6-f746-4547-a013-ddd741b5dad4 req-83d40571-2aba-41f2-8f60-522fc10746a3 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.268286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:21.268899 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:21.278845 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.279714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.280763 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.281582 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.284396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-165c45d6-f746-4547-a013-ddd741b5dad4 req-83d40571-2aba-41f2-8f60-522fc10746a3 service nova] Creating event network-vif-plugged:74e0a314-8c6c-4c1c-94b0-01a8822e91d5 for instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 on hv-cinder-80070 Dec 15 16:11:21.290906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-165c45d6-f746-4547-a013-ddd741b5dad4 req-83d40571-2aba-41f2-8f60-522fc10746a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037509 Dec 15 16:11:21.291992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 66/136] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:21.435888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.438666 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:21.440203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:21.448359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.448864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.449545 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.450124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.451485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.451696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1514f8f1-63e5-4fd4-a9a0-a8709e089b71 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.187490 Dec 15 16:11:21.452334 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.453592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 71/137] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:21 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:21.608346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.623394 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9259bce7-1362-4aca-984f-f0a49f0d2ac9 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.188581 Dec 15 16:11:21.623969 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 67/138] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:21 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:21.808376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:21.809242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:21.815701 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.816451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.817828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.818428 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.819699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:21.820313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:21.828838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.829509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.830719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.831244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.981599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.988277 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.989787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9ee2c717-e639-4533-a1cd-409833f47a29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.185812 Dec 15 16:11:21.993583 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 72/139] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:21 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:21.996200 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-44ac294d-7ffe-4e5d-9c7d-2e30589acd0e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.180084 Dec 15 16:11:21.996785 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 68/140] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:21 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:22.470338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:22.471096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:22.477401 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:22.477968 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:22.478949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:22.479602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:22.611026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:22.618795 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:22.620317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:22.621441 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f78b826d-22f7-439d-a549-e275b22cb6c7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.154859 Dec 15 16:11:22.622006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 73/141] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:22 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:22.639563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:22.640173 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:22.645902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:22.646257 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:22.647025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:22.647527 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:22.778654 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:22.785982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-43ea6f8a-0519-439f-9c19-1adafd5e0430 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.150005 Dec 15 16:11:22.786539 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 69/142] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:22 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:23.007138 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:23.008472 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:23.013331 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:23.014176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:23.014675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.015107 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.015881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.016310 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.019999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.020445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.021248 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.021704 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.166838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:23.174158 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c39536f7-b700-4c36-af65-9a6666600797 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.164423 Dec 15 16:11:23.175112 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 70/143] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:23 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:23.181467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:23.189048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aa5bbc5c-b851-423f-bc0b-dcd923ef705e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.185546 Dec 15 16:11:23.189660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 74/144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:23 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:23.310599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-61a232eb-64b9-4d61-bff4-3fbff2e7acc6 req-11f01509-7f5f-4eb8-906a-bc82dc37015d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "name": "network-vif-plugged", "status": "completed", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}, {"server_uuid": "4f52daeb-72c4-4375-a19f-7bad854fba4d", "name": "network-vif-plugged", "status": "completed", "tag": "dcc16873-43c3-4ab9-a1c5-a436ca059a16"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:23.312287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:23.312287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:11:23.319523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-61a232eb-64b9-4d61-bff4-3fbff2e7acc6 req-11f01509-7f5f-4eb8-906a-bc82dc37015d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.319956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-61a232eb-64b9-4d61-bff4-3fbff2e7acc6 req-11f01509-7f5f-4eb8-906a-bc82dc37015d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.332577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-61a232eb-64b9-4d61-bff4-3fbff2e7acc6 req-11f01509-7f5f-4eb8-906a-bc82dc37015d service nova] Creating event network-vif-plugged:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:11:23.333093 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-61a232eb-64b9-4d61-bff4-3fbff2e7acc6 req-11f01509-7f5f-4eb8-906a-bc82dc37015d service nova] Creating event network-vif-plugged:dcc16873-43c3-4ab9-a1c5-a436ca059a16 for instance 4f52daeb-72c4-4375-a19f-7bad854fba4d on hv-cinder-80070 Dec 15 16:11:23.340256 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-61a232eb-64b9-4d61-bff4-3fbff2e7acc6 req-11f01509-7f5f-4eb8-906a-bc82dc37015d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033185 Dec 15 16:11:23.340848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 71/145] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:23.639520 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:23.640146 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:23.645907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.646343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.647107 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.647526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.778400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:23.786316 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:23.787817 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:23.788907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c6301c1f-22fb-4d50-b282-1d0d5bed7a8f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.153063 Dec 15 16:11:23.789629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 75/146] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:23 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:23.803489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:23.804169 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:23.810226 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.810653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.811412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.811841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.938647 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:23.946352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9ab43552-21a6-4250-acfd-1466fbe5084b tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.146166 Dec 15 16:11:23.946902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 72/147] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:23 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:24.190595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.191439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:24.197922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.198369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.199164 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.200722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.208818 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.208818 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:24.212981 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.213456 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.214228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.214648 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.335347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:24.344271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b974bf53-ee79-4db7-8237-bdaeaffb0c7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.157276 Dec 15 16:11:24.355103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 76/148] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:24.356976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:24.364097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-13205b41-0106-4d00-b368-6065f9c5ec27 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.161715 Dec 15 16:11:24.364740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 73/149] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:24.807523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.808118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:24.813915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.814350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.815104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.815526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.942003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:24.950239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:24.951719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:24.952797 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2a3f39b3-cdf7-4a84-b4e5-9201d72dff46 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.149662 Dec 15 16:11:24.953700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 77/150] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:24.962820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.963445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:24.969142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.969615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.970370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.970794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.096332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:25.103980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-04ab0cba-bafc-4e71-8d0b-14551632f1bd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.144865 Dec 15 16:11:25.104545 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 74/151] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:25.361818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:25.362420 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:25.368272 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.368702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.369494 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.369921 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.381196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:25.381847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:25.388353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.388788 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.389586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.390150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.505834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:25.513566 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6eebd3e-7676-40ae-a3e6-7ae85d53263d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1317 microversion: 2.1 time: 0.155385 Dec 15 16:11:25.514139 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 78/152] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:25 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:25.531105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:25.538420 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5191a28e-0ac4-4769-a205-d1cd9b7e4006 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1322 microversion: 2.1 time: 0.160858 Dec 15 16:11:25.538980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 75/153] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:25 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:25.971032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:25.971627 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:25.977318 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.977779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.978540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.978964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.120187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:26.120788 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:26.126474 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.126920 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.127700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.128130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.138958 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.147178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.149197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.150550 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7e2ccc3b-2eea-4b0a-b501-8961e333610f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.183120 Dec 15 16:11:26.151115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 79/154] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:25 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:26.266158 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.273370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-61a5f1b4-d00b-42bd-8329-01ca68070d16 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.157148 Dec 15 16:11:26.274192 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 76/155] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:26 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:26.532053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:26.532965 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:26.540034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.540830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.542307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.543232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.555664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:26.556889 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:26.564162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.564922 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.566251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.566913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.725232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.735448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d1f28fd7-fed2-4e96-88c6-875512415e07 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1516 microversion: 2.1 time: 0.184254 Dec 15 16:11:26.747605 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.747605 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ad1e6cc0-4171-4f6d-bd0a-56f5f69ce5bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1507 microversion: 2.1 time: 0.220517 Dec 15 16:11:26.748608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 77/156] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:26 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:26.749227 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 80/157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:26 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:26.754462 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:26.755448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:26.762477 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.762971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.763773 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.764203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.841657 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lazy-loading 'flavor' on Instance uuid f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:11:26.971813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-688839a6-85c3-4337-923d-aff7cde52402 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50/action" status: 200 len: 32 microversion: 2.1 time: 0.221022 Dec 15 16:11:26.972455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 78/158] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:11:26 2021] POST /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:11:26.982881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:26.983771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:27.000409 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.001048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.002023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.002481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.171124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:27.171873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:27.178967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.179372 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.181181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.181783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.217054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:27.224538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8438f50b-63fc-4fff-9474-96bf31953b92 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.245865 Dec 15 16:11:27.225111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 81/159] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:26 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:27.291153 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:27.291745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:27.297916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.298353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.299118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.299540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.324670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:27.332441 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:27.334101 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:27.335243 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0f2f0812-dd5e-4645-9f81-27dd4aed93c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.169047 Dec 15 16:11:27.335809 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 79/160] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:27 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:27.431915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:27.439007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8e73906c-f754-42fb-ba39-025117ca3f76 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.151927 Dec 15 16:11:27.439570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 82/161] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:27 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:28.245781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:28.246378 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:28.252567 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.253122 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.253942 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.254406 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.352918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:28.353560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:28.359684 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.360127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.360902 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.361324 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.391327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.399917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3e644cbe-7c07-493e-8071-a3b9405cdde5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.158093 Dec 15 16:11:28.400496 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 80/162] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:28 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:28.455492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:28.456091 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:28.462008 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.462444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.463270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.463690 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.504181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.513959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.515734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.516987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ee66a136-c25c-4030-9a0c-5500f7257f38 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.168342 Dec 15 16:11:28.518768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 83/163] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:28 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:28.599437 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.606551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4f60d3ec-9d74-47b9-b99f-43080d241003 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.154569 Dec 15 16:11:28.607112 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 81/164] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:28 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:29.417329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.418727 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:29.424696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.425139 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.426171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.426603 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.537719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.538258 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:29.545189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.545662 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.546477 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.546902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.689185 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:29.689946 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:29.698988 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:29.700618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:29.701844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ad3fac90-a40c-4d1e-8d9c-a4f899744eb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.168156 Dec 15 16:11:29.702716 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 82/165] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:29 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:29.707043 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.707634 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:29.714218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4e926da9-c17c-4d3e-b635-132694b2558c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.300413 Dec 15 16:11:29.715119 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 84/166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:29 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:29.717785 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.718283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.719056 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.719685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.869294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:29.876497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-99e2dfb7-29f8-4750-802e-c93d47cd3bc3 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1315 microversion: 2.1 time: 0.172743 Dec 15 16:11:29.877085 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 83/167] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:29 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:30.720780 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:30.721435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:30.728537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:30.728993 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.730265 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:30.730724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.732606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:30.733464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:30.739588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:30.740010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.740795 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:30.741465 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.919824 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:30.932148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-02c83647-c35d-4e0b-9fb3-b70197fadd1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.203497 Dec 15 16:11:30.932734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 84/168] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:30 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:30.938878 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:30.939777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:30.948026 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:30.950172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.956611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:30.957120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.986823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:31.005380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:31.011157 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:31.013971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a1c922ce-184e-4a19-b618-ef2069850563 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1406 microversion: 2.20 time: 0.297340 Dec 15 16:11:31.016533 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 85/169] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:30 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:31.242754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:31.254270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7993cc7f-6274-4dd3-bdbd-161f7e91d664 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1502 microversion: 2.1 time: 0.318335 Dec 15 16:11:31.255977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 85/170] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:30 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1502 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:31.481210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "157a58ba-8a94-4199-942b-2e90edb62105"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:31.485976 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:31.499308 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:31.501358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:31.503408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:31.504905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:31.953095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:31.953873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:31.974179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:31.975019 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:31.976021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:31.977148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.586612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:32.595203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-22f7c4fd-e38f-45b1-bed5-0f69ad517972 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.646856 Dec 15 16:11:32.596387 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 86/171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:31 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:32.608382 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc94ebf4-cf0a-461d-a6db-61c495cfdd26 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.131430 Dec 15 16:11:32.609444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 86/172] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:11:31 2021] POST /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments => generated 194 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:32.610665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:32.611652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:32.637957 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.640067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.642605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.644712 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.802065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:32.811436 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:32.813306 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:32.814821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f9033569-1e3f-491e-81ad-2f2f58cf05e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1598 microversion: 2.20 time: 0.217264 Dec 15 16:11:32.825988 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 87/173] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:32 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1598 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:32.836666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:32.837612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:32.844174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.844649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.845440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.845870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.934891 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c3e8d8c-d3f1-4ac0-911b-5bae96b20ad0"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:32.936787 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:32.942933 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.943463 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.944318 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.944826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:33.065498 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2eedd72e-4a32-45f0-8062-bd88216b85fc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.229099 Dec 15 16:11:33.073918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 87/174] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Dec 15 16:11:32 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-interface => generated 284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:11:33.614207 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:33.615542 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:33.623535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:33.624187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:33.625186 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:33.625824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:34.557905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:34.565992 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e8fa5d26-fe85-4ca9-bda2-6d747330624d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.957364 Dec 15 16:11:34.576659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 88/175] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:33 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:35.578330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:35.579462 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:35.592861 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:35.593307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:35.594125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:35.594551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:35.759410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0dee9b6b-3d35-4f07-999c-040d63e6b2f9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 0.183477 Dec 15 16:11:35.760459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 89/176] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:35 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:35.766454 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:35.775130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:35.787722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:35.788226 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:35.790531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:35.791295 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:36.079973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:36.089436 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32ee639d-9879-4549-8f4a-2d4f21186210 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.327546 Dec 15 16:11:36.096774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 90/177] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:35 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:36.109424 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-cbf8eb4e-da19-4a89-97c9-a7846e07b0a6 req-e51a2355-d66b-433b-91a2-dfb093ecdb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:36.113228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:36.113228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:11:36.116352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-977aae5f-7f87-4add-850c-887760806efd tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "POST /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.183895 Dec 15 16:11:36.120980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 88/178] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:11:32 2021] POST /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8/os-volume_attachments => generated 194 bytes in 3191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:36.124720 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-cbf8eb4e-da19-4a89-97c9-a7846e07b0a6 req-e51a2355-d66b-433b-91a2-dfb093ecdb9e service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:36.125341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-cbf8eb4e-da19-4a89-97c9-a7846e07b0a6 req-e51a2355-d66b-433b-91a2-dfb093ecdb9e service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:36.145012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-cbf8eb4e-da19-4a89-97c9-a7846e07b0a6 req-e51a2355-d66b-433b-91a2-dfb093ecdb9e service nova] Creating event network-changed:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:11:36.153850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-cbf8eb4e-da19-4a89-97c9-a7846e07b0a6 req-e51a2355-d66b-433b-91a2-dfb093ecdb9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055700 Dec 15 16:11:36.159981 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 91/179] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:36.779471 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:36.784412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:36.794829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:36.797701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:36.798833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:36.799737 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:36.910734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f875ad61-ace1-4af7-aa12-27c908ed8565 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 0.141904 Dec 15 16:11:36.914932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 89/180] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:36 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:37.115270 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:37.116430 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:37.129156 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:37.129824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:37.130753 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:37.131415 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:37.541285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:37.551532 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fa07f264-92b1-4ee0-bf42-960a93d4b46c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.441434 Dec 15 16:11:37.553302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 92/181] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:37 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:37.922096 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:37.923701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:37.934950 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:37.935396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:37.936188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:37.954124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:38.096790 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e7f802d7-eac3-42de-9055-65fb093f56a6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 0.178458 Dec 15 16:11:38.099903 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 90/182] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:37 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:38.570846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:38.572822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:38.586162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:38.587640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:38.590520 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:38.591096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.109177 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:39.110207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:39.133616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.134236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.135028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.135453 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.206639 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:39.222077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a4c25d43-4901-495d-89da-cfc56c0059cf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.650421 Dec 15 16:11:39.239625 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 93/183] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:38 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:40.257968 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:40.258769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:40.270392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:40.270828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:40.271613 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:40.272043 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:40.636079 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:40.644361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a525e66b-3ee4-4ff7-8098-7e7dfe2ce9d9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.390083 Dec 15 16:11:40.648009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 94/184] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:40 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:41.666911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:41.668644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:41.677627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-460e79f1-5eb1-4bc0-9980-a352ce867a43 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 2.572677 Dec 15 16:11:41.678828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 91/185] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:39 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:41.684588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:41.687799 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:41.688796 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:41.691794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:41.980965 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:41.989297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8be1b688-4244-4137-bc18-e5c769ba0b85 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.326772 Dec 15 16:11:41.991705 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:41 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:42.689512 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:42.691098 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:42.713017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:42.713763 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:42.715312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:42.719233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:42.846259 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5d9cdee0-e2de-460a-b449-d2a345566189 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 0.161331 Dec 15 16:11:42.847421 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 92/187] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:42 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:43.010878 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:43.011635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:43.026493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:43.027240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:43.028197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:43.028790 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:43.506392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:43.514477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ed4de5a4-f2da-4f5e-9d93-39e5f2acba08 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.510143 Dec 15 16:11:43.515901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 96/188] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:43 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:43.859735 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:43.861441 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:43.883789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:43.884232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:43.885026 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:43.885484 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:44.069512 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fbf0a56d-e850-425a-9b60-15672bf6e4ff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 0.214529 Dec 15 16:11:44.074216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 93/189] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:43 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:44.534789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:44.537348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:44.546005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:44.546866 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:44.548188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:44.548826 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:44.750523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:44.760478 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-af94e479-b390-40f4-bb95-388cfcdf8c97 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.232134 Dec 15 16:11:44.763287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 97/190] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:44 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:45.049579 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1734245369", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "7d5230c5-6fc8-45a8-89a6-a1e34f97f335"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:45.092825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:45.095359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:45.113378 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:45.116684 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:45.119264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:45.121212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:45.169099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] validate_networks() for [('7d5230c5-6fc8-45a8-89a6-a1e34f97f335', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:11:45.233697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c780635b-56f9-41d4-b320-192b41aaf6a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 14 microversion: 2.20 time: 0.155695 Dec 15 16:11:45.234335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 98/191] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:45 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:45.682416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:11:45.682837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:11:45.683371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:11:45.683778 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:11:45.684186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:11:45.731644 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:45.733540 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:45.734592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:45.736579 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:45.784298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:45.785459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:45.787801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:11:45.797131 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:45.797601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for user df09b0b78f6646ed8c520c5c46b3eb58 and project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:11:45.801713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:45.802754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:45.804934 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:45.810967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:11:45.815590 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:11:45.897510 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-524c7adc-75ac-4414-839c-a6a477212cb5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857650 Dec 15 16:11:45.903890 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 94/192] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:11:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:11:45.911623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-26a2e5b4-f7cf-407d-bb87-3d7065b69083 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:45.912665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-26a2e5b4-f7cf-407d-bb87-3d7065b69083 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:45.993664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-26a2e5b4-f7cf-407d-bb87-3d7065b69083 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:46.002582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-26a2e5b4-f7cf-407d-bb87-3d7065b69083 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1218 microversion: 2.1 time: 0.097429 Dec 15 16:11:46.003350 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 95/193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:45 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:46.111739 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:46.134959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ac4ca8f-2ba6-438f-b50a-78dc98df770e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.353646 Dec 15 16:11:46.134959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 99/194] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:45 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:46.244619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:46.245762 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:46.262020 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:46.262542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:46.263387 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:46.269729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:46.388824 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fe2d8faf-ed1e-4fb5-831f-b312978fe797 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 868 microversion: 2.20 time: 0.148071 Dec 15 16:11:46.389485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 96/195] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:46 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 868 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:11:47.021898 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:47.022694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:47.034171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:47.037589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:47.041032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:47.044049 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:47.156137 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:47.158278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:47.183020 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:47.185587 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:47.190678 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:47.191148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:47.213450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:47.223814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f337b2a8-dca7-4c88-bde3-980f5ac8afef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1214 microversion: 2.1 time: 0.207524 Dec 15 16:11:47.237693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 100/196] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:47 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:47.400826 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:47.402246 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:47.410751 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:47.415307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:47.416350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:47.416940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:47.532676 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:47.541103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eba2f1c5-80df-47c3-9302-1023160c4f85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 7043 microversion: 2.20 time: 0.144399 Dec 15 16:11:47.541823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 101/197] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:47 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 7043 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:47.547938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3c2d8073-4470-4634-8c52-558830ce8917 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.399354 Dec 15 16:11:47.548526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 97/198] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:47 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:48.248382 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:48.249180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:48.263391 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:48.272483 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:48.277771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:48.281881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:48.480670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:48.501166 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2ae9b2c-1422-48dc-b7aa-d43ed6b76c46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1276 microversion: 2.1 time: 0.257637 Dec 15 16:11:48.504594 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 102/199] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:48 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:48.552255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:48.553140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:48.564972 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:48.565622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:48.568742 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:48.569189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:48.570659 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:48.571143 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:48.578395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:48.578846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:48.580010 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:48.580450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:48.778401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-240aefb2-6ad1-4c24-b78b-3ea088a7a274 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 11454 microversion: 2.20 time: 0.228864 Dec 15 16:11:48.779606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 98/200] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:48 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 11454 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:48.992357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:49.002671 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bed50742-896a-4e67-beaf-c5c1f386a72d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.442266 Dec 15 16:11:49.008689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 103/201] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:48 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:49.522452 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:49.523984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:49.538644 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:49.541224 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:49.542517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:49.544400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:49.793306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:49.795032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:49.810671 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:49.813619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:49.816698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:49.817974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:49.963184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0867a36f-7126-4243-b9ae-5de276d5410b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 15064 microversion: 2.20 time: 0.175992 Dec 15 16:11:49.963981 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 104/202] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:49 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 15064 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:11:50.027057 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:50.028108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:50.058982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:50.059954 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:50.065338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:50.066171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:50.122996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:50.135095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-917c2010-c0b4-4b83-8575-9559fd7a1030 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.615396 Dec 15 16:11:50.139325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 99/203] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:49 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:50.548371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:50.556199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f448b0f0-2f6f-4bd1-9214-a283c29eb2ca tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.536098 Dec 15 16:11:50.558748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 105/204] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:50 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:50.975566 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:50.977300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:50.991233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:50.992887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:50.994542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:50.995517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.121217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b8f402e1-c3d2-45e4-a64a-c9bd293ff342 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 17960 microversion: 2.20 time: 0.150115 Dec 15 16:11:51.122295 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 100/205] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:50 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 17960 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:11:51.156598 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:51.157609 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:51.173964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.176486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.177570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.179854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.556325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:51.567986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-249815d0-2206-4e00-ba79-96052997fb3f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.415450 Dec 15 16:11:51.578554 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:51.579867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:51.613522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 106/206] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:51 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:51.623064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.623942 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.628422 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.629292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.922038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-e59a878c-e630-4f69-95ea-ad6d6dca5cd7 req-a9d0e5c7-60b5-438c-9560-602adba29117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522fff52-5215-429c-badc-a248701121d4", "tag": "8839979d-1332-42c7-8845-4f562f79a7ba"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:51.923907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:51.923907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:11:51.947316 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e59a878c-e630-4f69-95ea-ad6d6dca5cd7 req-a9d0e5c7-60b5-438c-9560-602adba29117 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.947727 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e59a878c-e630-4f69-95ea-ad6d6dca5cd7 req-a9d0e5c7-60b5-438c-9560-602adba29117 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.990154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-e59a878c-e630-4f69-95ea-ad6d6dca5cd7 req-a9d0e5c7-60b5-438c-9560-602adba29117 service nova] Creating event network-changed:8839979d-1332-42c7-8845-4f562f79a7ba for instance 522fff52-5215-429c-badc-a248701121d4 on hv-cinder-80070 Dec 15 16:11:52.005375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-e59a878c-e630-4f69-95ea-ad6d6dca5cd7 req-a9d0e5c7-60b5-438c-9560-602adba29117 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088338 Dec 15 16:11:52.006083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 107/207] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:52.024099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:52.025268 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.046679 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.047383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.048357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.048944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.117417 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:52.127077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:11:52.133418 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-60a24e41-5364-434e-9faf-7931f78cbf6a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.560063 Dec 15 16:11:52.136551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 101/208] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:51 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:52.161147 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:52.162177 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.191142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.191595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.192390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.192819 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.346628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c3a413c4-d4e1-4383-8da0-d9ac8968f904 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 18608 microversion: 2.20 time: 0.199887 Dec 15 16:11:52.347745 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 102/209] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:52 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 18608 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:52.392905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-24d25571-ad37-4349-aa6e-7fc677b8be30 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 204 len: 0 microversion: 2.1 time: 0.384503 Dec 15 16:11:52.394083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 108/210] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:11:52 2021] DELETE /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:11:52.404040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:52.405038 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.421932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.423626 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.426041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.427149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.610747 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:52.611719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.621562 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.622045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.622822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.623258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.842820 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:52.866782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-559854de-4f1d-4293-8c68-2544e1a3c8f6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.260663 Dec 15 16:11:52.876742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 109/211] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:52 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:53.076720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:53.084885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-28823e58-05b7-4f63-a7d0-916af261c680 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1554 microversion: 2.1 time: 0.685815 Dec 15 16:11:53.085926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 103/212] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:52 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1554 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:53.152467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:53.153012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:53.170978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.171848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:53.174160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.175509 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:53.358740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:53.359851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:53.366400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.367380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:53.368577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.369010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:53.413783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:53.423443 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d6e32bf-a3e4-4fde-84d0-ee66b97da718 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.275095 Dec 15 16:11:53.425606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 110/213] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:53 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:53.525551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0d69503a-64d9-4174-a2f4-c9d2ba77a398 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 20172 microversion: 2.20 time: 0.170456 Dec 15 16:11:53.527065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 104/214] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:53 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 20172 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:53.886188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:53.886792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:53.893094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.893775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:53.894547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.895027 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.105612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:54.106390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:54.119995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:54.120360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.121070 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:54.121430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:54.122110 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.128555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-41dc3797-c243-4e81-be6a-6e92a1969417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.248432 Dec 15 16:11:54.133881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 111/215] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:53 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:54.378849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:54.389193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-db5a5838-8d00-4783-aeca-e4dd654f2c05 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1554 microversion: 2.1 time: 0.290236 Dec 15 16:11:54.390278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 105/216] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:54 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:54.449547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:54.452165 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:54.461596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:54.462392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.463568 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:54.464773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.537764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:54.540036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:54.554430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:54.555401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.556536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:54.557289 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.658860 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c63bb30d-3c83-446e-a1ea-04abc748aff0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 21783 microversion: 2.20 time: 0.124536 Dec 15 16:11:54.662944 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 106/217] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:54 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 21783 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:11:54.668518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:54.676505 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e28b823f-9489-445b-985b-f264723d47dc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.237412 Dec 15 16:11:54.679263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 112/218] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:54 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:55.151282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:55.151959 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:55.161632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.166379 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.168119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.168948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.406149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:55.407415 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:55.427975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.431392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.432511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.433063 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.706025 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:55.715717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-13fbf5ad-c434-4dcc-9fa7-85dec39a4e88 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1554 microversion: 2.1 time: 0.313101 Dec 15 16:11:55.717468 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 113/219] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:55 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:55.737778 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:55.739131 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:55.757543 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:55.759357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.761288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.762397 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.764228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.766958 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-01ce984b-652b-41ed-b5a4-391dcf9f76f1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.618542 Dec 15 16:11:55.777606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 107/220] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:55 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:55.785485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:55.787377 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:55.810179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.810984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.813916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.814615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.904723 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f3375f08-9e1d-4ab7-a9ac-dbdd8b4ee763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 22974 microversion: 2.20 time: 0.184819 Dec 15 16:11:55.905404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 114/221] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:55 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 22974 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:56.203111 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:56.216603 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c26af17-17ad-4fee-a4d3-66666b3c8026 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.437147 Dec 15 16:11:56.218628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 108/222] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:55 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:56.457860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-e642f83d-89a3-40e6-91aa-879ac8393228 req-c70bc335-512d-419b-86c9-9d44625c8d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d69eb5-4a68-41bb-9246-0cb932ad79d8", "name": "network-vif-deleted", "tag": "74e0a314-8c6c-4c1c-94b0-01a8822e91d5"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:56.459464 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:56.459464 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:11:56.474392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e642f83d-89a3-40e6-91aa-879ac8393228 req-c70bc335-512d-419b-86c9-9d44625c8d34 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.475921 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e642f83d-89a3-40e6-91aa-879ac8393228 req-c70bc335-512d-419b-86c9-9d44625c8d34 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.507491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-e642f83d-89a3-40e6-91aa-879ac8393228 req-c70bc335-512d-419b-86c9-9d44625c8d34 service nova] Creating event network-vif-deleted:74e0a314-8c6c-4c1c-94b0-01a8822e91d5 for instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 on hv-cinder-80070 Dec 15 16:11:56.517802 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-e642f83d-89a3-40e6-91aa-879ac8393228 req-c70bc335-512d-419b-86c9-9d44625c8d34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063964 Dec 15 16:11:56.518775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 115/223] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:56.734407 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:56.738351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:56.756342 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.760506 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.762840 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.764204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.785093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:56.785822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:56.800576 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.803709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.806870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.809352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.945034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e314d7ae7a491ab057a93961c7c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd876e8f6e278448196f8e8989149241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:56.957105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-14546f45-e3fc-4d61-86c4-8bc22fa8a177 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 200 len: 1346 microversion: 2.1 time: 0.226603 Dec 15 16:11:56.957734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 109/224] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:56 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 1346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:56.980508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:56.984633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:57.002645 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:57.003102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:57.005142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:57.008467 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:57.133757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:57.143935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ea946f2f-36f0-47aa-a739-da1c8b20d4c4 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.362750 Dec 15 16:11:57.145526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 116/225] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:56 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:57.160189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bf75a784-d4c4-4fab-b619-7ebb821ce644 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 23977 microversion: 2.20 time: 0.188706 Dec 15 16:11:57.166048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 110/226] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:56 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 23977 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:57.235865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:57.237414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:57.253571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:57.253951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:57.254735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:57.255162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:57.685471 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:57.695357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-824349fd-4791-4213-962c-50a712f11fe5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.463789 Dec 15 16:11:57.702312 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 117/227] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:57 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:57.978881 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:57.979574 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:58.000045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.000489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.008021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.008550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.015592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9aa8c94e-42be-49ad-ad94-3474fc1e0c40 req-ab3e51a2-3711-45d6-840e-910c76b64797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522fff52-5215-429c-badc-a248701121d4", "name": "network-vif-plugged", "status": "completed", "tag": "8839979d-1332-42c7-8845-4f562f79a7ba"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:58.017038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:58.017038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:11:58.045525 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] HTTP exception thrown: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. Dec 15 16:11:58.046987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9aa8c94e-42be-49ad-ad94-3474fc1e0c40 req-ab3e51a2-3711-45d6-840e-910c76b64797 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.047644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9aa8c94e-42be-49ad-ad94-3474fc1e0c40 req-ab3e51a2-3711-45d6-840e-910c76b64797 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.063579 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Returning 404 to user: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:58.065014 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b883d1b1-77d2-4112-912d-557aaa9a61d2 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 404 len: 111 microversion: 2.1 time: 0.094180 Dec 15 16:11:58.067888 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 111/228] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:57 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:58.078853 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9aa8c94e-42be-49ad-ad94-3474fc1e0c40 req-ab3e51a2-3711-45d6-840e-910c76b64797 service nova] Creating event network-vif-plugged:8839979d-1332-42c7-8845-4f562f79a7ba for instance 522fff52-5215-429c-badc-a248701121d4 on hv-cinder-80070 Dec 15 16:11:58.093185 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9aa8c94e-42be-49ad-ad94-3474fc1e0c40 req-ab3e51a2-3711-45d6-840e-910c76b64797 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081333 Dec 15 16:11:58.094435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 118/229] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:58.162609 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:58.163319 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:58.173218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.173964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:58.175042 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.175279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:58.176405 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.178235 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.194334 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.197110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.199560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.200082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.313094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-be1d0ea3-6945-4d20-923a-4bdf312a3b81 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 24694 microversion: 2.20 time: 0.144312 Dec 15 16:11:58.314152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 119/230] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:58 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 24694 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:58.324963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:58.328488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:58.343612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.346160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.347158 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.348556 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.381971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] HTTP exception thrown: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. Dec 15 16:11:58.383660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Returning 404 to user: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:58.386283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3f911de7-8138-40ef-8d4f-f65cc1f2bf72 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.070667 Dec 15 16:11:58.387884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 120/231] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:11:58 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:58.627923 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:58.646418 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-db276b67-885a-4c9d-a1aa-c86689b68d60 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.488856 Dec 15 16:11:58.650357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 112/232] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:58 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:58.718836 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:58.720023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:58.730747 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.732610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:58.737229 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:58.739118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.038618 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:59.053015 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3f8b68c0-2f64-4624-b0fa-3b3285220f3e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.338131 Dec 15 16:11:59.053573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 121/233] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:58 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:59.325710 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:59.326738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:59.341961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.342931 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.344299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.346181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.474688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-991d3af8-1728-48dd-bc9e-f06325112c2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 25550 microversion: 2.20 time: 0.152928 Dec 15 16:11:59.475993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 113/234] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:11:59 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 25550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:59.677423 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:59.679735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:59.697502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.697956 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.704833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.706607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.818029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:59.818608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:59.848015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.852546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.861117 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.863307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.927376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] HTTP exception thrown: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. Dec 15 16:11:59.928300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Returning 404 to user: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:59.929281 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-074a81c5-2872-4b80-b430-e4aedb422321 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 404 len: 111 microversion: 2.1 time: 0.115160 Dec 15 16:11:59.933755 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 114/235] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:11:59 2021] DELETE /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:11:59.940968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:59.942454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] [instance: 17d69eb5-4a68-41bb-9246-0cb932ad79d8] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:59.948787 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.949487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.950657 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:59.951727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:59.970114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] HTTP exception thrown: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. Dec 15 16:11:59.971159 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] Returning 404 to user: Instance 17d69eb5-4a68-41bb-9246-0cb932ad79d8 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:59.972191 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bd40d45e-f607-468d-beeb-cd66ec764583 tempest-DeleteServersTestJSON-55467242 tempest-DeleteServersTestJSON-55467242-project] 10.222.0.36 "GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8" status: 404 len: 111 microversion: 2.1 time: 0.037760 Dec 15 16:11:59.973502 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 115/236] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:59 2021] GET /compute/v2.1/servers/17d69eb5-4a68-41bb-9246-0cb932ad79d8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:12:00.070586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:00.071457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:00.080618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:00.081069 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:00.085668 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:00.086761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:00.225799 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:00.238478 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e5ba1edc-f0d2-4255-83ff-744eb7c49e70 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1318 microversion: 2.1 time: 0.576067 Dec 15 16:12:00.246147 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 122/237] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:59 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:00.486055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:00.486980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:00.500283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:00.500733 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:00.501570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:00.502002 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:00.610898 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:00.618966 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9078fbb0-6cfb-43a0-ad3a-ecf77703dbbf tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.552844 Dec 15 16:12:00.628318 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 116/238] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:00 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:00.637678 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2f732362-d6ec-4f36-834e-9e314dae1606 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 26215 microversion: 2.20 time: 0.154873 Dec 15 16:12:00.641528 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 123/239] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:00 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 26215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:01.265029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:01.265846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:01.284782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:01.285471 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:01.286516 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:01.288165 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:01.641261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:01.650545 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:01.679053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:01.679669 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:01.680769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:01.681286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.027155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:02.037329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a69893ae-286e-4c01-ab81-241039abd7f8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.405179 Dec 15 16:12:02.047180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:02.051604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 124/240] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:01 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:02.065953 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a54e1366-a2b9-470e-b8ed-e964c75fce85 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1508 microversion: 2.1 time: 0.805619 Dec 15 16:12:02.067025 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:02.067875 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 117/241] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:01 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1508 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:02.071537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:02.096063 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "157a58ba-8a94-4199-942b-2e90edb62105"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:02.098010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:02.126689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.129077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.130787 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.137431 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.140149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.140617 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.144873 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.151260 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.308421 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0e666f45-ad37-4166-8dfc-f180243c27d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 27258 microversion: 2.20 time: 0.247417 Dec 15 16:12:02.310616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 125/242] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:02 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 27258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:02.386830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] HTTP exception thrown: Invalid volume: volume 157a58ba-8a94-4199-942b-2e90edb62105 is already attached to instances: cdd5f486-3302-4f15-ba29-0a1734919fcb Dec 15 16:12:02.387618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Returning 400 to user: Invalid volume: volume 157a58ba-8a94-4199-942b-2e90edb62105 is already attached to instances: cdd5f486-3302-4f15-ba29-0a1734919fcb {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:12:02.388642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7fd3e865-3b97-4c44-b9d0-896c61e92f8d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.300444 Dec 15 16:12:02.394404 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 118/243] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:12:02 2021] POST /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4/os-volume_attachments => generated 174 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:12:02.516489 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:02.517320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:02.526501 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.527234 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.528368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.529003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.792490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lazy-loading 'services' on Instance uuid cdd5f486-3302-4f15-ba29-0a1734919fcb {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:12:03.067345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:03.067970 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:03.079425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:03.079886 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:03.080701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:03.081149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:03.169323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a22c4a0f-0485-4103-b0c5-49c35f41f28e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments/157a58ba-8a94-4199-942b-2e90edb62105" status: 202 len: 0 microversion: 2.1 time: 0.647461 Dec 15 16:12:03.170606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 126/244] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:12:02 2021] DELETE /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments/157a58ba-8a94-4199-942b-2e90edb62105 => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:03.180245 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:03.181971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:03.190568 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:03.191302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:03.192388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:03.193032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:03.428891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-625c3bb7-5bbe-429f-9715-74cd718c38bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240330 Dec 15 16:12:03.428891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 127/245] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:12:03 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:03.454426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:03.454426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:03.495545 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:03.497607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:03.499989 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:03.500448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:03.859501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:03.868913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-95dafd0f-613b-4e5d-8409-5475ea8be4ab tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.809271 Dec 15 16:12:03.876954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 119/246] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:03 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:04.057302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-978ec904-9508-42a0-a751-930d54e1696a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 27963 microversion: 2.20 time: 0.631323 Dec 15 16:12:04.057945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 128/247] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:03 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 27963 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:04.427726 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:04.428714 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:04.452445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.454306 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.455170 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.457496 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.889896 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:04.890761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:04.912773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.914163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.918405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.922870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:05.026606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d2cb2c6f-1773-4a2c-8711-66a8838f1969 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.604071 Dec 15 16:12:05.027198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 120/248] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:12:04 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb/os-volume_attachments => generated 25 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:05.073488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:05.073488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:05.090850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:05.092073 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:05.095106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:05.095672 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:05.227301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4bd8c645-b79d-42a3-9a9d-73afe8c2bc68 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 28149 microversion: 2.20 time: 0.163233 Dec 15 16:12:05.231804 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 121/249] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:05 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 28149 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:05.390030 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0adf5605-8f95-4f98-8a31-86bedc2070b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Action: 'create', calling method: .version_select at 0x7f88b83ca310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-930439470"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:05.421700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-0adf5605-8f95-4f98-8a31-86bedc2070b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Getting quotas for project 174453a286344e0fa34d91d3ebcb8436. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:05.427457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-0adf5605-8f95-4f98-8a31-86bedc2070b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Getting quotas for user 0a15ca0a8cc74415815f5613f72b8105 and project 174453a286344e0fa34d91d3ebcb8436. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:05.500674 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:05.511326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e10cf293-1670-4cab-8eb4-cd2a2349a307 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.623553 Dec 15 16:12:05.512444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 129/250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:04 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:05.533197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-11253948", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "7d5230c5-6fc8-45a8-89a6-a1e34f97f335"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:05.660423 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] validate_networks() for [('7d5230c5-6fc8-45a8-89a6-a1e34f97f335', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:06.363751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-0adf5605-8f95-4f98-8a31-86bedc2070b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Getting quotas for project 174453a286344e0fa34d91d3ebcb8436. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:06.370825 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-0adf5605-8f95-4f98-8a31-86bedc2070b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Getting quotas for user 0a15ca0a8cc74415815f5613f72b8105 and project 174453a286344e0fa34d91d3ebcb8436. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:06.389612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0adf5605-8f95-4f98-8a31-86bedc2070b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.003581 Dec 15 16:12:06.402701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 122/251] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 16:12:05 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:06.410298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:06.411857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:06.419858 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:06.420638 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:06.421730 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:06.422396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:06.527789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-074b1aa1-a679-4adc-b37a-67558d776b3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 28294 microversion: 2.20 time: 0.122784 Dec 15 16:12:06.529212 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 123/252] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:06 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 28294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:06.536328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:06.540070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:06.549293 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:06.550115 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:06.551133 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:06.551778 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.194091 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:07.218107 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-870735ef-855f-4fa5-a229-c26fbee534ac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.687190 Dec 15 16:12:07.227010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 124/253] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:06 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:07.242368 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1716926518", "imageRef": "2fc1938d-a923-4531-8e0c-47b715f9c958", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-930439470", "networks": [{"uuid": "d9e2f581-0cb5-4ae9-aba0-eb2ae7e5c1de"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:07.348806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] validate_networks() for [('d9e2f581-0cb5-4ae9-aba0-eb2ae7e5c1de', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:07.630990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:07.633159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:07.634491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:07.635384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:07.636065 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:07.661710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.669302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.670643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.671267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.720896 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:07.726336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for user df09b0b78f6646ed8c520c5c46b3eb58 and project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:07.753764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:07.755802 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:07.838096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d02be283-5fe9-45b1-b036-70376498b7cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313381 Dec 15 16:12:07.839495 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 130/254] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:12:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:12:07.857932 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:07.859285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:07.873142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.874573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.875985 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.876625 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.985367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-86202a3e-2faa-45c0-9faf-e4a5c08d4fca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 28494 microversion: 2.20 time: 0.139239 Dec 15 16:12:07.996002 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 131/255] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:07 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 28494 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:08.004142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8f314a5a-d839-433d-a845-71798c70c079 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:08.004937 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8f314a5a-d839-433d-a845-71798c70c079 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:08.324122 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8f314a5a-d839-433d-a845-71798c70c079 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:08.332761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8f314a5a-d839-433d-a845-71798c70c079 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1216 microversion: 2.1 time: 0.334210 Dec 15 16:12:08.333350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 132/256] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:07 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1216 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:08.339076 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:08.342480 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:08.358606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:08.359306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:08.360485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:08.361080 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:08.943734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:08.963010 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-16a77d64-71f8-40bb-8197-4066aa2611d8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.625322 Dec 15 16:12:08.964450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 133/257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:08 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:09.006244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:09.008298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:09.028232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.030236 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.035214 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.035792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.209258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-85ec3656-839c-4071-8f60-269057b531fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 28608 microversion: 2.20 time: 0.208590 Dec 15 16:12:09.211387 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 134/258] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:08 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 28608 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:09.269125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:09.269125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:09.269125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:09.269125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:09.269125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:09.304205 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.310161 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.311447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.313708 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.354997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:09.355831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:09.378822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.389902 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.390771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.391211 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.420702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Getting quotas for project 174453a286344e0fa34d91d3ebcb8436. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:09.440826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Getting quotas for user 0a15ca0a8cc74415815f5613f72b8105 and project 174453a286344e0fa34d91d3ebcb8436. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:09.486740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:09.499919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fc1938d-a923-4531-8e0c-47b715f9c958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:09.610328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6608d810-1d5a-44fa-aa0e-c80920ed3fe7 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.378700 Dec 15 16:12:09.611419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 125/259] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:12:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:12:09.626794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-99d08ac7-a355-487b-b1ad-7071e6bdaab9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:09.628139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-99d08ac7-a355-487b-b1ad-7071e6bdaab9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:09.649148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:09.656832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f8fdd337-4f05-4e83-bf1d-24fe29753087 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1268 microversion: 2.1 time: 0.310024 Dec 15 16:12:09.662427 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 135/260] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:09 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1268 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:09.980684 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:09.982292 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:09.994348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.995161 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.996437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.997094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.123464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-99d08ac7-a355-487b-b1ad-7071e6bdaab9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:10.160250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-99d08ac7-a355-487b-b1ad-7071e6bdaab9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1258 microversion: 2.1 time: 0.531277 Dec 15 16:12:10.164706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 126/261] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:09 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1258 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:10.223986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:10.225233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:10.245112 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.247065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.249313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.250761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.389516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:10.402877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-97cabadf-fb19-4a75-8506-92f80c5ddb0a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1522 microversion: 2.1 time: 0.426117 Dec 15 16:12:10.403929 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 136/262] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:09 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:10.418488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d42b751e-2e2c-46e3-a383-31c6cf278b94 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 28608 microversion: 2.20 time: 0.199044 Dec 15 16:12:10.419594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 127/263] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:10 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 28608 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:10.676946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:10.678803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:10.690202 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.690977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.693134 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.698367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.846942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:10.858022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3d4a4b4e-5f46-440e-805b-e6b42ca8d903 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1274 microversion: 2.1 time: 0.186477 Dec 15 16:12:10.860492 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 137/264] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:10 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:11.185206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:11.186258 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:11.202498 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.202829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.219682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.223103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.420764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:11.422664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:11.453257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.454197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.457349 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.459306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.492739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:11.501556 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-70367abf-b7cf-429c-adbc-662b9bf3c889 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1310 microversion: 2.1 time: 0.323956 Dec 15 16:12:11.504905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 128/265] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:11 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:11.515376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:11.521077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:11.536858 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.538124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.545044 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.546357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.691632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2425e7b6-83c7-4da0-8c2d-3c1e8a4bcc02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 28608 microversion: 2.20 time: 0.185175 Dec 15 16:12:11.693241 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 129/266] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:11 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 28608 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:11.877919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:11.878885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:11.904003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.908090 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.910063 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.915426 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.028225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.046930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6d60ed21-bd82-4ed6-b129-c81761326fe1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1502 microversion: 2.1 time: 0.622449 Dec 15 16:12:12.049040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 138/267] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:11 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:12.067271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:12.067793 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:12.079605 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.081892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.082755 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.083201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.730255 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.738433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5e76961f-67b0-4318-8fb8-3e5c69759e62 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1516 microversion: 2.1 time: 0.675579 Dec 15 16:12:12.746864 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 139/268] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:12 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1516 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:12.751586 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:12.757143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:12.781469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.782140 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.784765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.785369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.944046 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.962808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e5fc0d7d-4278-4327-9a0d-49c92c78943b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1316 microversion: 2.1 time: 0.214441 Dec 15 16:12:12.963201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 140/269] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:12 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:12.968552 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:12.969737 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:12.984332 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.985055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.987731 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:13.001622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:13.251827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-daca404c-731b-4fcf-bd5b-d492f2bbe0e5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 29479 microversion: 2.20 time: 0.287108 Dec 15 16:12:13.253335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 141/270] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:12 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 29479 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:13.575051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:13.599348 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-91959527-d06a-4480-9b63-304a7e4ce9b5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 1.726751 Dec 15 16:12:13.612294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 130/271] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:11 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:13.981463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:13.983176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:13.993656 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.003787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.005278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.006015 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.265654 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:14.267310 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:14.287954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.290483 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.292863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.294070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.489493 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-161efba5-b552-4994-8618-d42074b2bbb4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 30721 microversion: 2.20 time: 0.227706 Dec 15 16:12:14.490701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 131/272] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:14 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 30721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:14.523201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:14.542604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c3131459-a70d-4ae0-bae0-bcee981971e4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1316 microversion: 2.1 time: 0.564627 Dec 15 16:12:14.546441 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 142/273] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:13 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:14.617586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:14.619036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:14.654576 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.655370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.656408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.656995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.914183 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:14.915785 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:14.922544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.939045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.942329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.943100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.042436 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lazy-loading 'flavor' on Instance uuid 4f52daeb-72c4-4375-a19f-7bad854fba4d {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:12:15.261650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8dc2b2d4-42f9-40ba-98b8-98ba570bd455 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action" status: 200 len: 32 microversion: 2.1 time: 0.351641 Dec 15 16:12:15.264771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 143/274] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:14 2021] POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:12:15.288159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:15.289734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:15.302499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.306017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.307491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.308159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:16.437281 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:16.462950 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4cd1ca6f-cf4a-4d7f-a10e-93075ac6b869 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 1.846833 Dec 15 16:12:16.469592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 132/275] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:14 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:16.481433 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:16.482389 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:16.521448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:16.521899 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:16.523346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:16.523856 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.105967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:17.118936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eb673110-5bc6-4feb-8efc-6374a806c73a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 1.836500 Dec 15 16:12:17.123617 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 144/276] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:15 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:17.136384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:17.139545 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:17.161900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.163876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.166634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.168160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.579555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:17.593093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fd4f026d-b9e6-4b24-af37-6f153740f728 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.466709 Dec 15 16:12:17.595773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 145/277] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:17 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:17.612145 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:17.613127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:17.640150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.644479 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.646439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.648875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:18.940894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:18.949132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-06c37180-1239-4237-bf8b-abc83a0644cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 1.350624 Dec 15 16:12:18.952571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 146/278] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:17 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:18.969845 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:18.970773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:18.987367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:18.989244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:18.993150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:18.994021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:19.587958 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:19.624698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-27e4b85d-1fb8-49bf-8eff-486b5b4540f7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.670673 Dec 15 16:12:19.642725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 147/279] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:18 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:19.654474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9b53715f-32ec-40c1-9339-b54249bdb124 req-a87632ac-24a6-48c7-8132-def976139b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b857430f-d0fd-4457-b7e6-10a1052f95bc", "tag": "bb6a09e3-ff84-472c-af29-bc280464c380"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:19.661658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:19.661658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:12:19.688125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9b53715f-32ec-40c1-9339-b54249bdb124 req-a87632ac-24a6-48c7-8132-def976139b7f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:19.689186 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9b53715f-32ec-40c1-9339-b54249bdb124 req-a87632ac-24a6-48c7-8132-def976139b7f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:19.721904 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9b53715f-32ec-40c1-9339-b54249bdb124 req-a87632ac-24a6-48c7-8132-def976139b7f service nova] Creating event network-changed:bb6a09e3-ff84-472c-af29-bc280464c380 for instance b857430f-d0fd-4457-b7e6-10a1052f95bc on hv-cinder-80070 Dec 15 16:12:19.737098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9b53715f-32ec-40c1-9339-b54249bdb124 req-a87632ac-24a6-48c7-8132-def976139b7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092782 Dec 15 16:12:19.739003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 148/280] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:19.775219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:19.777683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:19.795376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:19.795936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:19.797632 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:19.799093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.327512 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:20.341971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b7a14df4-c3d4-4397-9267-2d6ee985489b tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.600857 Dec 15 16:12:20.345624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 149/281] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:19 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:20.363136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:20.367364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:20.395665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:20.402588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.404777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:20.406824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.973907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:20.988822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fdb1af98-5fc8-43a4-94ee-9df960303b46 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.640341 Dec 15 16:12:21.007870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 150/282] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:20 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:21.015998 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:21.019166 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:21.035081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.036319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.040130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.042979 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.458523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:21.467489 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66eb9c7c-f2de-4691-87cd-2982622826e1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.458124 Dec 15 16:12:21.473684 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 151/283] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:21 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:21.878534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ccdd44e2-c48a-4a38-8f39-b437129349c0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: .version_select at 0x7f88b8d73700>, body: {"keypair": {"name": "tempest-keypair-426090185"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:21.917512 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ccdd44e2-c48a-4a38-8f39-b437129349c0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:21.922769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ccdd44e2-c48a-4a38-8f39-b437129349c0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for user ff251ac504444235af8055f7a9c8e0a5 and project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:24.074868 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ccdd44e2-c48a-4a38-8f39-b437129349c0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:24.093711 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ccdd44e2-c48a-4a38-8f39-b437129349c0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for user ff251ac504444235af8055f7a9c8e0a5 and project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:24.153714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ccdd44e2-c48a-4a38-8f39-b437129349c0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 2.678636 Dec 15 16:12:24.154548 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 152/284] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 16:12:21 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:24.163463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:24.164192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:24.171179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.172005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.173172 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.173779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.665824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:24.680798 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-64062f84-2c56-4966-bc62-9cdd109fd348 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.524704 Dec 15 16:12:24.684927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 153/285] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:24 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:24.692644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:24.693499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:24.712777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.713483 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.715341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.716443 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.949950 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:24.961466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7841c04c-cdb4-44dd-a93b-d65ddbae696b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.272650 Dec 15 16:12:24.973325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 154/286] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:24 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:24.981634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:24.983697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:24.997614 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.998369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.999346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:25.000060 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:25.302775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:25.311439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7696a5c8-e9d1-4dce-a31d-fd54908e1aac tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.336572 Dec 15 16:12:25.317709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 155/287] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:24 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:25.763387 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-03e1ef27-5e19-49a3-b471-bd064765805a tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Action: 'create', calling method: .version_select at 0x7f88b8d88dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1178071824"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:25.808547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-03e1ef27-5e19-49a3-b471-bd064765805a tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Getting quotas for project fc22adb06b1e405ea619c273ffb94020. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:25.822277 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-03e1ef27-5e19-49a3-b471-bd064765805a tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Getting quotas for user aaa0c20019c84107b8324cd915ff78db and project fc22adb06b1e405ea619c273ffb94020. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:26.202344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-03e1ef27-5e19-49a3-b471-bd064765805a tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Getting quotas for project fc22adb06b1e405ea619c273ffb94020. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:26.206619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-03e1ef27-5e19-49a3-b471-bd064765805a tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Getting quotas for user aaa0c20019c84107b8324cd915ff78db and project fc22adb06b1e405ea619c273ffb94020. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:26.223185 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-03e1ef27-5e19-49a3-b471-bd064765805a tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.904028 Dec 15 16:12:26.223927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 156/288] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 16:12:25 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:26.228350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:26.229179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:26.234969 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:26.235414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:26.236208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:26.236640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:26.652967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:26.662266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dfd4fdb4-4a97-422d-99fe-6db94204b6e9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.437139 Dec 15 16:12:26.663716 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 157/289] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:26 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:26.668639 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:26.669601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:26.678061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:26.678648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:26.679712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:26.680041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:26.992682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:27.005784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c20d1ef3-a004-4a9b-971b-d5e9ffae8a94 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.340601 Dec 15 16:12:27.006375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 158/290] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:26 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:27.048576 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:27.049494 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:27.066942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.067392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.075749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.076227 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.374660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:27.407640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d84c9db1-396e-4eb4-a7cd-f23b2f98c689 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.384347 Dec 15 16:12:27.408898 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 159/291] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:27 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:27.474826 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2129489223", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b76a42d-a289-476f-a87a-d1a85520dc8f"}], "security_groups": [{"name": "tempest-securitygroup--1594666529"}], "key_name": "tempest-keypair-426090185", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:27.783680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] validate_networks() for [('8b76a42d-a289-476f-a87a-d1a85520dc8f', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:28.375652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:28.376446 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:28.378789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:28.379303 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:28.379987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:28.389811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.390398 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.391317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.391848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.411759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for project 710c6a0383874f9b946e8376a79787b6. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:28.417017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for user ff251ac504444235af8055f7a9c8e0a5 and project 710c6a0383874f9b946e8376a79787b6. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:28.430218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:28.432710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:28.521162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-86a92185-6998-4b57-b124-e6fe2f44c9d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.055346 Dec 15 16:12:28.525163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 160/292] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:12:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:12:28.536242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:28.538006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:28.549926 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.550376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.551175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.551614 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.793575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:28.802217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b6204bce-1d05-4e67-b9de-ce59fc21083d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.274330 Dec 15 16:12:28.803297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 161/293] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:28 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:28.808899 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:28.809557 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:28.832402 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.832496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.833287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.833760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.135758 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6d8c5cbe-edd3-45aa-b48c-32c904fd9952 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 200 len: 38282 microversion: 2.20 time: 12.664799 Dec 15 16:12:29.141677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 133/294] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:16 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 38282 bytes in 12666 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:29.159328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:29.160037 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:29.190589 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.191189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.191844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.204824 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.290699 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:29.306374 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4aa4914-bf7c-44c2-9ef8-58556a7afd13 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.499570 Dec 15 16:12:29.308020 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 162/295] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:28 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:29.316641 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6199cc96-39cf-44d9-9fb6-b0e7316edbcc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:29.318193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6199cc96-39cf-44d9-9fb6-b0e7316edbcc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:29.500734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6199cc96-39cf-44d9-9fb6-b0e7316edbcc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:29.508223 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6199cc96-39cf-44d9-9fb6-b0e7316edbcc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1237 microversion: 2.1 time: 0.197711 Dec 15 16:12:29.508792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 163/296] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:29 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1237 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:29.522910 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:29.523709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:29.536082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.536554 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.537427 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.537927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.606155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7a7f965a-dae5-43c1-9f9c-54b486016037 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/ips" status: 200 len: 150 microversion: 2.20 time: 0.093616 Dec 15 16:12:29.608946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 164/297] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Dec 15 16:12:29 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/ips => generated 150 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:12:29.821537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:29.822236 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:29.833702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.837020 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.840801 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.842279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.938045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:29.952179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-533c01d2-6c6f-44a8-a2ef-4e1d7c7cb865 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.814263 Dec 15 16:12:29.954001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 134/298] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:29 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:30.325118 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:30.325771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:30.339615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.341982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.343232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.343884 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.553225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:30.582021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4323b531-8902-4974-a14d-c4166095662e tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.746339 Dec 15 16:12:30.582635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 165/299] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:29 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:30.590034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:30.591225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:30.602170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.603648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.604513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.605037 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.744861 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:30.756484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-55d4ba52-1731-479d-9f76-9bcba7bbd20d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1295 microversion: 2.1 time: 0.172478 Dec 15 16:12:30.757137 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 166/300] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:30 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1295 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:30.974638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:30.975337 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:31.000290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.001230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.001573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.003809 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.368408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:31.380292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-705f0d60-e079-42c7-92a3-dfb3ead16c21 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 1.059031 Dec 15 16:12:31.381497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 135/301] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:30 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:31.604760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:31.605454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:31.614386 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.614833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.624447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.624899 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.696354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:31.706777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-46b545e8-6d34-407c-b9e4-88a878cfb7f2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.738696 Dec 15 16:12:31.734609 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 167/302] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:30 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:31.745178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-a93caeb8-b512-4e8a-b8ac-54b8be9e9f18 req-476f7d1d-f8f2-4ec1-99db-9d1a83235fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:31.763000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:31.763000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:12:31.785581 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a93caeb8-b512-4e8a-b8ac-54b8be9e9f18 req-476f7d1d-f8f2-4ec1-99db-9d1a83235fbb service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.786105 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a93caeb8-b512-4e8a-b8ac-54b8be9e9f18 req-476f7d1d-f8f2-4ec1-99db-9d1a83235fbb service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.819105 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-a93caeb8-b512-4e8a-b8ac-54b8be9e9f18 req-476f7d1d-f8f2-4ec1-99db-9d1a83235fbb service nova] Creating event network-changed:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:12:31.852805 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-a93caeb8-b512-4e8a-b8ac-54b8be9e9f18 req-476f7d1d-f8f2-4ec1-99db-9d1a83235fbb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114238 Dec 15 16:12:31.855593 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 168/303] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:31.881036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:31.882014 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:31.902747 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.903199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.905051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.905521 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.061039 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:32.072011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c7a264a-2483-4483-9cf2-4619343d919f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.472952 Dec 15 16:12:32.073088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 136/304] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:31 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:32.103947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:32.111809 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2d1d948-66ff-4a83-b73d-8e290b4ffbdc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1295 microversion: 2.1 time: 0.248182 Dec 15 16:12:32.115048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 169/305] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:31 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1295 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:32.389043 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:32.389742 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:32.415181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:32.415789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:32.445940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.446639 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.447617 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.448195 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.452279 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.453109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.456042 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.457727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.533188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lazy-loading 'flavor' on Instance uuid 58bcd354-b76f-4f2c-8062-f7888f226c7c {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:12:33.039072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:33.050640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ec1b677-704f-40be-a762-93e7c744fa4c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.641718 Dec 15 16:12:33.052563 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 170/306] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:32 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:33.070931 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.072124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.083597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.087220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.090050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.090499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.153326 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-92e74f6a-6d06-4b8f-b72d-bfd120178b19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 202 len: 0 microversion: 2.20 time: 0.767592 Dec 15 16:12:33.156991 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 137/307] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:32 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:12:33.160614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.161474 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.169425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.170321 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.171622 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.172265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.401225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:33.418065 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb08f1ff-0ec9-469f-bdb2-416e7e1ffac8 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.363885 Dec 15 16:12:33.419590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 171/308] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:33.424440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.428395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.445709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.449996 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.451040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.451500 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.843513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:33.854585 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:33.856955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-794cd141-4c68-4b4b-9c86-205560db587f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.433658 Dec 15 16:12:33.858612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 172/309] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:33.865640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.867275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.871156 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ad2c4bef-f0a2-467e-a864-9c0f9a9cb859 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.715393 Dec 15 16:12:33.877677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 138/310] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:33.888502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.889203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.890180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.891013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.019667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-4bcad695-d632-47f7-b4e4-2494c5d95674 req-bf777f42-031f-4af4-ac0f-304f449b4149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e", "tag": "22b2ec2e-29af-439e-80e6-b88c63e49caf"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:34.021588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:34.021588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:12:34.030299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-4bcad695-d632-47f7-b4e4-2494c5d95674 req-bf777f42-031f-4af4-ac0f-304f449b4149 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.030938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-4bcad695-d632-47f7-b4e4-2494c5d95674 req-bf777f42-031f-4af4-ac0f-304f449b4149 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.059600 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-4bcad695-d632-47f7-b4e4-2494c5d95674 req-bf777f42-031f-4af4-ac0f-304f449b4149 service nova] Creating event network-changed:22b2ec2e-29af-439e-80e6-b88c63e49caf for instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e on hv-cinder-80070 Dec 15 16:12:34.077137 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-4bcad695-d632-47f7-b4e4-2494c5d95674 req-bf777f42-031f-4af4-ac0f-304f449b4149 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061814 Dec 15 16:12:34.078095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 139/311] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:34.097145 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:34.099233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:34.138176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.138632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.139454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.142942 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.247290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:34.264186 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:34.266200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:34.267706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3b480b14-6b11-4d0e-9a7a-99f5482b514f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.407986 Dec 15 16:12:34.268595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 173/312] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:34.437332 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:34.438667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:34.458689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.461420 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.462488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.464564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.472398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:34.500841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e11629a3-06c7-4efa-b0e2-78f3c4fb05d1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.412178 Dec 15 16:12:34.506153 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 140/313] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:34 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:34.875054 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:34.875730 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:34.899388 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.899844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.906957 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.907693 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.932783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:34.948461 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-88155c65-5b44-459e-9a82-481ac1de211d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.515390 Dec 15 16:12:34.950789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 174/314] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:34 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:34.970210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:34.972072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.008569 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.009578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.011234 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.011969 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.208807 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.220343 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dbb0a240-5951-4ac5-bf47-af7628a45f17 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.349423 Dec 15 16:12:35.221594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 141/315] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:34 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:35.286614 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.289570 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:35.290397 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.295369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-87953cf5-a0d3-4f61-be2d-05dd5ad4d558 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.343273 Dec 15 16:12:35.295926 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 175/316] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:34 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:35.298203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.298817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.299777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.300355 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.496544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.504522 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.506300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.507331 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-00e0489c-a972-46c5-aba6-d006f98c0e9c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.223891 Dec 15 16:12:35.507834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 142/317] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:35 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:35.525751 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:35.526378 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.537174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.537689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.539196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.539706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.703338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.711968 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-41e02325-34b5-42be-a1fd-04c2cfd32381 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.192174 Dec 15 16:12:35.712535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 176/318] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:35 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:35.966827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:35.967549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.974716 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.975155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.975971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.976401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.107630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.114815 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0cbf823d-a872-4864-afc2-e75424a45209 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.152393 Dec 15 16:12:36.115382 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 143/319] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:35 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:36.237057 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:36.237680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:36.243975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.244419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.245263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.245636 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.311886 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:36.312691 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:36.319927 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.320413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.321227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.321681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.428019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.437040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c7415836-f662-49bf-b413-d26973d569b6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.203712 Dec 15 16:12:36.437672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 177/320] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:36 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:36.487943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.495879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a9e3f29c-64ce-486e-9e53-20117b0fbf31 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.187515 Dec 15 16:12:36.500870 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 144/321] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:36 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:36.525344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:36.526110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:36.532120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.532832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.533644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.534076 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.680438 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.693208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.693208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.693997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e32f437b-16d4-42df-b8d0-92bf7d94f1cf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.172990 Dec 15 16:12:36.703162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 178/322] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:36 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:36.728077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:36.728771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:36.734596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.735183 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.740081 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.740081 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.883708 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.891466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-84832f97-6d0c-40f8-8945-aaa9f81caa1e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.167283 Dec 15 16:12:36.892371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 145/323] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:36 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.131940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.133236 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.147597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.148379 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.149267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.149938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.282885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.290516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d8578eb7-b19a-4ce5-86a8-df1e16482636 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.162318 Dec 15 16:12:37.291261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 179/324] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.454211 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.454811 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.461404 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.461862 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.462640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.463067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.512668 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.513274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.519052 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.519589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.520475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.520933 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.602012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.609100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-475669ed-db27-4bd7-a883-310e40ca2dd1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.158600 Dec 15 16:12:37.609695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 146/325] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.713131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.714002 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.720251 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.723093 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.723543 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.727274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.727723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.729518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b58be5c7-ec0b-4b57-8347-569a5d6d68ce tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.220519 Dec 15 16:12:37.730263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 180/326] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.869052 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.877447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.878943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.880108 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5e8eac4d-5c96-4b08-80fc-8cff53810276 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.171448 Dec 15 16:12:37.880667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 147/327] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:37.909729 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.910335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.916714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.917162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.917983 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.918410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.062923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:38.071278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5ec1a367-4f74-4101-a054-ea02f161e0ab tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.165438 Dec 15 16:12:38.071848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 181/328] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:38.307639 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.308695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.315285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.316297 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.317107 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.317577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.526257 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:38.536111 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c39bdd7-2501-4f67-95c1-05eaf0ea428a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.232516 Dec 15 16:12:38.547204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 148/329] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:38.628749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.631103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.638903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.639346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.640395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.640827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.748003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.749222 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.761944 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.762708 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.764086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.764757 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.911922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:38.919936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c8d554da-6a4b-4c8b-8b69-5366648949c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.296107 Dec 15 16:12:38.920946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 182/330] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:38.925531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.926559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.934130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.934801 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.935901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.936674 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.941176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:38.950696 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-baf6ad56-44d0-4b15-bfbd-82ea2b6bc216 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.206854 Dec 15 16:12:38.952776 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 149/331] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:39.089007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:39.089764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:39.099397 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.099953 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.101630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.104155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.132604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.143440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.145427 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.147040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-db5b71f3-e8d7-401f-adda-c687f83839cd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.224910 Dec 15 16:12:39.148122 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 183/332] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:39.274951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.288218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a95accc5-bd4c-4e9c-bd4f-cd68516cb397 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.204086 Dec 15 16:12:39.288621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 150/333] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:39 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:39.457482 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-ca10e6a6-fcde-43cd-8077-5c4222582e9c req-a93f56b7-ad8b-4438-a4c7-4fdd6315bda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b857430f-d0fd-4457-b7e6-10a1052f95bc", "name": "network-vif-plugged", "status": "completed", "tag": "bb6a09e3-ff84-472c-af29-bc280464c380"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:39.459237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:39.459237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:12:39.467448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ca10e6a6-fcde-43cd-8077-5c4222582e9c req-a93f56b7-ad8b-4438-a4c7-4fdd6315bda4 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.467987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ca10e6a6-fcde-43cd-8077-5c4222582e9c req-a93f56b7-ad8b-4438-a4c7-4fdd6315bda4 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.481267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-ca10e6a6-fcde-43cd-8077-5c4222582e9c req-a93f56b7-ad8b-4438-a4c7-4fdd6315bda4 service nova] Creating event network-vif-plugged:bb6a09e3-ff84-472c-af29-bc280464c380 for instance b857430f-d0fd-4457-b7e6-10a1052f95bc on hv-cinder-80070 Dec 15 16:12:39.486871 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-ca10e6a6-fcde-43cd-8077-5c4222582e9c req-a93f56b7-ad8b-4438-a4c7-4fdd6315bda4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038696 Dec 15 16:12:39.487917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 184/334] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:39.554806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:39.555546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:39.568004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.568461 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.569828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.570571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.766062 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.775461 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cbb408e9-1558-41e3-821a-2d171cdfef10 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.224957 Dec 15 16:12:39.776049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 151/335] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:39 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:39.938854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:39.939546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:39.946642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.947093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.947911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.948366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.967190 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:39.967796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:39.973372 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.973863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.974627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.975048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.088001 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.095671 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-91938aae-8f42-490f-9511-0ac966e90e84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.161238 Dec 15 16:12:40.096242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 185/336] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:39 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:40.124327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.131444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-de4dd8e4-ccc0-48f5-83d4-348cfa59a2c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.167858 Dec 15 16:12:40.132499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 152/337] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:39 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:40.166151 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:40.166749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:40.172450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.172948 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.173697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.174123 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.305342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.305594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:40.306106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:40.314868 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.315688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.316341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.317009 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.317473 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.318167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.319456 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4c874b14-1148-4115-8628-160107691b7c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.157111 Dec 15 16:12:40.320185 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 186/338] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:40 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:40.449307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.456355 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3fd0eb10-daee-4dab-b265-1ed19506634e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.155293 Dec 15 16:12:40.456918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 153/339] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:40 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:40.793012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:40.793742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:40.799743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.800317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.801090 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.801578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.950006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.957696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ca6a6cfd-7fa2-47e9-a828-c294f4cb851a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.168313 Dec 15 16:12:40.958270 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 187/340] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:40 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:41.113558 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.114163 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.120423 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.120867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.121667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.122097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.148602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.149332 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.155329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.155777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.156553 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.156988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.254448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.262417 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-23065ec5-6bae-4b78-9d87-52a44b15036f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.152491 Dec 15 16:12:41.262982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 154/341] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:41.289700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.296789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b7f8ee4-307f-4ab9-8d02-759e044e59b5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.152712 Dec 15 16:12:41.297346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 188/342] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:41.337848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.338497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.344997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.345468 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.346268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.346702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.472909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.473537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.479559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.479999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.480767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.481194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.488921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.497199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.498715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.499862 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b85d4c88-c4e0-40eb-9bee-4957204bcf3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.166080 Dec 15 16:12:41.500408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 155/343] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:41.612458 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.620269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0825f330-88d3-4a0e-940d-f64c430329de tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.150987 Dec 15 16:12:41.620900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 189/344] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:41.974732 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.975373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.981709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.982180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.982941 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.983367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.110848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.118457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f1272472-d78d-4ad6-8ab6-dad8139f50fb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.147362 Dec 15 16:12:42.119041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 156/345] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:42.279806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.281712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.290368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.290814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.291597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.292027 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.314079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.314682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.320927 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.321641 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.322424 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.322849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.438921 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.447099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-36763f48-a15c-4d21-8693-c9d07aeb07f4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.171440 Dec 15 16:12:42.447780 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 190/346] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:42.473617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.486456 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-26d38c4e-35e0-4151-ae7d-6c46c49f4433 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.171737 Dec 15 16:12:42.492099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 157/347] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:42.519028 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.519659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.526412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.526846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.527621 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.528045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.637851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.638373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.644004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.644446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.645220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.645681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.658685 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.667197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.668683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.669882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f83190e8-f41d-4fbd-adb8-a5bfe58e744b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.154911 Dec 15 16:12:42.670640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 191/348] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:42.803378 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.812875 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eaff9b41-425e-465d-bcd2-b0acea518bff tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.178596 Dec 15 16:12:42.813481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 158/349] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:43.138576 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.139198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.145216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.145664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.146444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.146870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.286390 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.295314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2f55394d-14ac-48b9-9cda-3c5d95258c84 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.162398 Dec 15 16:12:43.295897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 192/350] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:43.465407 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.466124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.472601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.473057 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.473934 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.474308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.476078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-eaa56356-67e1-4c41-bc46-47c15ce1aff3 req-8418cf84-5641-4fb7-9d8b-e0b309d5a3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "name": "network-vif-plugged", "status": "completed", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:43.478181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:43.478181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:12:43.486762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-eaa56356-67e1-4c41-bc46-47c15ce1aff3 req-8418cf84-5641-4fb7-9d8b-e0b309d5a3ea service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.487204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-eaa56356-67e1-4c41-bc46-47c15ce1aff3 req-8418cf84-5641-4fb7-9d8b-e0b309d5a3ea service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.500551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-eaa56356-67e1-4c41-bc46-47c15ce1aff3 req-8418cf84-5641-4fb7-9d8b-e0b309d5a3ea service nova] Creating event network-vif-plugged:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:12:43.506040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-eaa56356-67e1-4c41-bc46-47c15ce1aff3 req-8418cf84-5641-4fb7-9d8b-e0b309d5a3ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034756 Dec 15 16:12:43.506984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 193/351] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:43.512283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.512985 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.520759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.521213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.522714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.523180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.615065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.623270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1feb1450-39c9-4347-878d-09b93ac82e4e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.162457 Dec 15 16:12:43.623840 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 159/352] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:43.658644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.666522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ab23513-acfb-42f0-8ba7-00102e7f8d1d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.157956 Dec 15 16:12:43.667094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 194/353] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:43.689292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.690004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.696466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.696906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.697690 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.698113 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.827775 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.830451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.831089 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.835345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.836833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.837064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.837526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.838137 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-42237870-3e91-4f91-a8ac-9104127caa76 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.152515 Dec 15 16:12:43.838331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.838706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 160/354] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:43.838882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.970914 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.978844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-88b907e0-e590-4cd0-aa4a-44a29eb06d91 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1316 microversion: 2.1 time: 0.152093 Dec 15 16:12:43.979412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 195/355] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:44.312841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:44.313470 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.319913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.320394 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.321218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.321866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.510050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:44.520596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eb590bb4-7929-4d73-9a02-9ed87a1671ae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.211250 Dec 15 16:12:44.521544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 161/356] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:44 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:44.640217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:44.640809 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.647624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.648159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.648943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.649377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.682954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:44.683552 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.689416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.689853 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.690983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.691230 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.838367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:44.847610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3effe709-7f61-4f02-a511-e5adb19f55e9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.210946 Dec 15 16:12:44.849147 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 196/357] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:44 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:44.857068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:44.857784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.865273 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.866143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.867416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.867952 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.869152 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:44.878043 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6f37a63f-ec44-4357-a8f7-6c0aaf09c84f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.199299 Dec 15 16:12:44.879197 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 162/358] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:44 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:44.995440 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:44.996151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.002630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.003307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.004197 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.004726 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.102525 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.110757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.117206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.119050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e58f39f6-6e0f-4827-87d8-6aa7ab723449 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.266236 Dec 15 16:12:45.119750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 197/359] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:44 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:45.189969 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.197787 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ab8ba36f-81eb-4e63-8e38-fac28962f9bf tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1506 microversion: 2.1 time: 0.205858 Dec 15 16:12:45.198674 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 163/360] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:44 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:45.539896 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:45.540551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.546912 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.547354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.548130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.548555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.872907 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:45.872907 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.875354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.875899 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.876608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.877044 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.905698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.915022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8d36a1c9-0207-4385-b0db-fbb9f69587d0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.379883 Dec 15 16:12:45.924511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 198/361] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:45 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:45.924511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:45.924511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.935611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.936145 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.937013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.937559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.032685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.044993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6d95172b-fe33-4543-a794-42ccb025e598 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.182149 Dec 15 16:12:46.046027 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 164/362] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:45 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:46.076904 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.084124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1616d192-e2bc-4993-a463-2acb8d25f11f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.167272 Dec 15 16:12:46.084852 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 199/363] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:45 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:46.137952 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:46.138632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:46.144600 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.145544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.146511 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.146982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.286870 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.295205 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.296779 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.298049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-da9a59d5-2988-456e-acfd-1e9525c391d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.163732 Dec 15 16:12:46.298681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 165/364] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:46 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:46.931689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:46.932972 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:46.939204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.939644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.940410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.940837 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.062416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:47.062930 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.070313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.070711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.071491 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.071916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.074574 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.081767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-85e8f881-b547-42e3-b0a3-b769f3f6f100 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.154458 Dec 15 16:12:47.089822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 200/365] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:46 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:47.101469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:47.102079 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.107992 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.108435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.109209 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.109670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.207109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.215033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6eaacf47-5702-4532-97c5-616e452976bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.156684 Dec 15 16:12:47.215607 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 166/366] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:47 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:47.239450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.247130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-49b60b0e-c149-4cdf-ac05-a39499f7b294 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.149506 Dec 15 16:12:47.247694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 201/367] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:47 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:47.316038 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:47.316571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.322982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.323418 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.324175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.324597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.454023 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.461759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.463262 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.464416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e738d110-4d7e-43fe-9f4c-6349aa6dbda0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.152049 Dec 15 16:12:47.464982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 167/368] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:47 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:48.099171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:48.099710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.105939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.106385 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.107157 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.107592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.231301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:48.231900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.237265 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.238066 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.238506 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.239271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.239697 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.245093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-348d5717-7acf-45ca-8d34-aae9ac111562 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.149559 Dec 15 16:12:48.245691 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 202/369] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:48 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:48.263235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:48.263830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.269847 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.270296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.271069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.271499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.369638 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.376801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-452e142e-b1f1-4e5e-8407-160d244f32fa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.149017 Dec 15 16:12:48.377370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 168/370] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:48 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:48.404527 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.411804 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-935cb3bd-4715-46b7-940d-2aa15c6aebd2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.152079 Dec 15 16:12:48.412366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 203/371] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:48 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:48.482188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:48.482788 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.488487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.488920 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.489702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.490131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.622771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.630682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.632527 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.633713 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-edfbd171-dcd8-4256-9db8-89743ec6117f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.155127 Dec 15 16:12:48.634275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 169/372] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:48 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:49.261560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:49.262171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.268403 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.268851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.269665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.270104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.393820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:49.394324 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.397819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.400964 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.401426 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.402380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.402820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.405236 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-900c3fce-cc43-477d-b33f-6828a9191c7c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.147349 Dec 15 16:12:49.406009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 204/373] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:49 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:49.429756 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:49.430404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.436645 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.437234 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.438237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.438827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.547957 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.555711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b0b2fe99-a377-4380-8aa5-1b5a38d037bd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.165570 Dec 15 16:12:49.556308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 170/374] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:49 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:49.576719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.584020 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cad3b014-8168-4d4c-b73e-91602018cdbd tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1358 microversion: 2.1 time: 0.158754 Dec 15 16:12:49.584584 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 205/375] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:49 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:49.653800 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:49.653800 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.659356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.659799 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.660563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.660995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.805077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.812663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.814181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.815312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-02484608-9ca6-4a17-9379-49b4c25d5d6d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.166892 Dec 15 16:12:49.815856 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 171/376] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:49 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:50.424803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:50.425296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-c101df9d-297b-4f59-9996-9769d474ac5f req-9e15d02b-a025-4947-a8ac-f5e23fd11a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e", "name": "network-vif-plugged", "status": "completed", "tag": "22b2ec2e-29af-439e-80e6-b88c63e49caf"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:50.425687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.426593 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:50.426593 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:12:50.434020 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.434473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.435365 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.435853 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.439268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c101df9d-297b-4f59-9996-9769d474ac5f req-9e15d02b-a025-4947-a8ac-f5e23fd11a54 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.439711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c101df9d-297b-4f59-9996-9769d474ac5f req-9e15d02b-a025-4947-a8ac-f5e23fd11a54 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.452585 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-c101df9d-297b-4f59-9996-9769d474ac5f req-9e15d02b-a025-4947-a8ac-f5e23fd11a54 service nova] Creating event network-vif-plugged:22b2ec2e-29af-439e-80e6-b88c63e49caf for instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e on hv-cinder-80070 Dec 15 16:12:50.457964 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-c101df9d-297b-4f59-9996-9769d474ac5f req-9e15d02b-a025-4947-a8ac-f5e23fd11a54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036556 Dec 15 16:12:50.458483 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 172/377] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:50.569849 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:50.573036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:50.573909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.579069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-72b3cfb2-899e-4557-94ee-e6cbf7a60dae tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.159779 Dec 15 16:12:50.579654 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 206/378] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:50 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:50.579850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.580298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.581078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.581537 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.601624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:50.602220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.608051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.608486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.609267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.609708 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.717102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:50.724511 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3b2ec692-321a-4c43-99bb-b94ed8167a3b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.156156 Dec 15 16:12:50.725201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 173/379] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:50 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:50.729926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85eb15ec-0205-4163-9df6-f82379c1eda3"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:50.731034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.736645 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.737376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.738079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.738509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.750334 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:50.758838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-20dccc1a-832c-47d5-ba37-8688d457fe72 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1548 microversion: 2.1 time: 0.160701 Dec 15 16:12:50.759834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 207/380] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:50 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:50.775649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:50.776383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.782838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.783282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.784055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.784484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.918746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:50.925939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dfea52ce-f623-48d7-b93b-564cf586905c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1548 microversion: 2.1 time: 0.154042 Dec 15 16:12:50.926463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 208/381] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:50 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:50.931300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:50.931892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.937368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.937819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.938593 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.939021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.066955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.074674 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.076171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.077328 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1f5f084b-28f6-4744-84a4-f48937498078 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.149962 Dec 15 16:12:51.077913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 209/382] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:50 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:51.082348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:51.086432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:51.086432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:12:51.087418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.088154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Searching by: {'deleted': False, 'project_id': '174453a286344e0fa34d91d3ebcb8436'} {{(pid=116084) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 16:12:51.094437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.094881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.095687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.096116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.185689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.multi_cell_list [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116084) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 16:12:51.275242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34fdf36a-9734-4910-90de-cb67781980f8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196229 Dec 15 16:12:51.275746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 210/383] 10.222.0.36 () {58 vars in 1124 bytes} [Wed Dec 15 16:12:51 2021] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:51.285724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:51.286327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.292133 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.292575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.293343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.293811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.421649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.428726 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e9b0eec0-1218-4707-a621-248168aa01d5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1548 microversion: 2.1 time: 0.146728 Dec 15 16:12:51.429302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 211/384] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:51 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:51.596560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:51.597190 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.603657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.604100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.604872 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.605300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.751330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.759478 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ba75d2d-dc5f-4c6e-ba19-5efde2a7897c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.166378 Dec 15 16:12:51.760118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 212/385] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:51 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:51.764424 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:51.765020 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.770889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.771332 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.772669 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.773093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.904565 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.911940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-87d41716-c04f-42be-bc76-e543c763756e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.150888 Dec 15 16:12:51.912498 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 213/386] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:51 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:52.095438 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:52.096036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:52.102852 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.103202 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.104194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.104617 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.235450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:52.243152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:52.244633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:52.245808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-29d0650a-e71c-4969-9148-f8170c0b2fc4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.154064 Dec 15 16:12:52.246368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 214/387] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:52 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:52.776729 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:52.777330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:52.783788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.784231 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.784995 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.785449 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.915459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:52.922553 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e445e1e1-de6e-455b-ba73-ef148d84fdc6 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.149277 Dec 15 16:12:52.923117 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 215/388] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:52 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:52.928686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:52.929255 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:52.934966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.935433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.936216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.936675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.068230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:53.075945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9c80caa4-1dba-4efc-b6b5-dfa32e9a4c98 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.150790 Dec 15 16:12:53.076506 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 216/389] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:52 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:53.264224 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:53.264816 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:53.270611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.270986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.271746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.272195 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.397743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:53.405170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:53.406682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:53.408066 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e4db4fe5-c9ff-4840-afcc-9efeb97449b4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.147473 Dec 15 16:12:53.408619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 217/390] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:53 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:53.795436 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b2f59a89-3533-45cd-b72f-a16a7e5bfa52 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.068913 Dec 15 16:12:53.796314 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 174/391] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:12:50 2021] POST /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 194 bytes in 3071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:53.939492 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:53.940068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:53.946923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.947380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.948127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.948564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.076761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:54.083983 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bb2c55c5-2f2c-4569-a8f3-684846764da7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.148200 Dec 15 16:12:54.084551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 218/392] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:53 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:54.093875 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:54.094557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:54.100924 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.101365 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.102155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.102583 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.248140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:54.257662 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e6f6b67e-abce-4baf-8388-fb974f74ca06 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.167907 Dec 15 16:12:54.258823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 175/393] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:54 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:54.425121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:54.425746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:54.432714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.433135 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.433943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.434370 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.565615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:54.573760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:54.575245 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:54.576382 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-13206e79-5b98-4d9f-9d8f-88b9d18b0f2f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.154884 Dec 15 16:12:54.576943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 219/394] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:54 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:55.101294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:55.102123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:55.108783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.109224 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.110022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.110451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.238047 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.245759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ab2aedb8-3dd3-401f-9c71-b0649e89fcfe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.148758 Dec 15 16:12:55.246321 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 176/395] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:55 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:55.274748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:55.275351 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:55.281449 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.281896 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.282937 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.283367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.301862 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1616823410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1178071824", "security_groups": [{"name": "tempest-secgroup-smoke-1843005674"}], "networks": [{"uuid": "f52f28d1-1904-41cf-a6e0-eda3b950cc3e"}], "block_device_mapping_v2": [{"uuid": "30063313-fda3-4ead-9673-95d3d7079bf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:55.417029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.421578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] validate_networks() for [('f52f28d1-1904-41cf-a6e0-eda3b950cc3e', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:55.427109 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-178100b4-6b99-4a55-90ef-7c72526d8914 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.155970 Dec 15 16:12:55.427674 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 220/396] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:55 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:55.594768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:55.595401 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:55.601046 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.601524 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.602598 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.603022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.738385 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.747433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.748910 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.750113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-24da1221-1754-4dc0-ab42-23fbce32d245 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.159056 Dec 15 16:12:55.750687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 221/397] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:55 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:55.976488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:55.976975 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:55.977549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:55.978025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:55.978543 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:55.987602 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.988024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.988830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.989256 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.004946 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Getting quotas for project fc22adb06b1e405ea619c273ffb94020. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:56.009367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Getting quotas for user aaa0c20019c84107b8324cd915ff78db and project fc22adb06b1e405ea619c273ffb94020. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:56.063357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:56.065688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30063313-fda3-4ead-9673-95d3d7079bf0',volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:56.183347 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f3c6536f-7836-4202-add8-e3165c897baa tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885050 Dec 15 16:12:56.184312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 177/398] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:12:55 2021] POST /compute/v2.1/servers => generated 406 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:12:56.193437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2c45219f-dbd1-4d23-bfd3-045c0cc5642b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:56.194159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2c45219f-dbd1-4d23-bfd3-045c0cc5642b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:56.249540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2c45219f-dbd1-4d23-bfd3-045c0cc5642b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:56.255897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2c45219f-dbd1-4d23-bfd3-045c0cc5642b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1089 microversion: 2.1 time: 0.065964 Dec 15 16:12:56.257244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 222/399] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:56 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:56.265690 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:56.266333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:56.273694 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.274128 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.275083 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.275519 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.412385 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:56.419912 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-00ff3d08-c090-42a8-b809-042724b819e2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.158394 Dec 15 16:12:56.420485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 178/400] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:56 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:56.446168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:56.447352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:56.454161 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.454604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.455389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.455820 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.593814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:56.601589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-76bf0b55-d779-406e-b9ca-caf5c6f8ea24 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.161398 Dec 15 16:12:56.602149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 223/401] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:56 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:56.769363 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:56.769982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:56.776187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.776625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.777407 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.777929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.905348 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:56.913736 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:56.915216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:56.916381 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6b8158d6-83b3-4866-8fbd-de0f9e9b05e4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.150758 Dec 15 16:12:56.916935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 179/402] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:56 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:57.273067 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:57.273622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:57.279434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.279881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.280652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.281084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.337894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:57.344889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9393bf69-1c26-4939-8baf-241aa3b82fc5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1139 microversion: 2.1 time: 0.075501 Dec 15 16:12:57.345466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 224/403] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:57 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1139 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:57.438777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:57.439385 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:57.445536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.445986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.446766 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.447199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.582352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:57.591204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cce929bf-728e-4408-86d4-6f1eec1b9add tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.155980 Dec 15 16:12:57.591886 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 180/404] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:57 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:57.622395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:57.623022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:57.629262 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.629735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.630575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.631101 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.761513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:57.768716 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ad6acdd6-770e-422e-a93f-301a7a97891d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.150013 Dec 15 16:12:57.769274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 225/405] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:57 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:57.934912 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:57.935517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:57.941967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.942413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.943195 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.943625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.089103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:58.097085 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:58.098572 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:58.099713 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0eaa8f91-09e5-4022-81c5-4d8b15e48a07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.168878 Dec 15 16:12:58.100775 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 181/406] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:57 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:58.362092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:58.362697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:58.369160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.369631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.370400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.370832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.432750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:58.440163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-38668e58-b667-4a47-9303-0508c67e359d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1187 microversion: 2.1 time: 0.081689 Dec 15 16:12:58.440728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 226/407] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:58 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:58.608358 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:58.608989 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:58.614825 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.615217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.616018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.616446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.760717 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:58.769544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-80de8a54-c3ac-49d8-aba4-8254989d87b3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.164821 Dec 15 16:12:58.770107 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 182/408] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:58 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:58.785831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:58.786662 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:58.793448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.793897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.794678 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.795113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.927897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:58.936160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a5f1482d-d666-4e6d-9b8f-5d9da5ab646d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.154129 Dec 15 16:12:58.936978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 227/409] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:58 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:59.118309 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:59.118981 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:59.125202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.125772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.126615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.127048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.262400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:59.270497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:59.271969 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:59.274053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6b5c24bc-a0c2-4688-9717-3083dfdcf8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.160041 Dec 15 16:12:59.274635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 183/410] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:59 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:59.457278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:59.457865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:59.464439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.464891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.465698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.466132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.524437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:59.531644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c1bbd552-193c-4922-aa1d-f5cec157c6b6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1187 microversion: 2.1 time: 0.077990 Dec 15 16:12:59.532206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 228/411] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:59 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1187 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:59.788835 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:59.789427 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:59.795055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.795496 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.796267 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.796691 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.923813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:59.931696 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-28fedd74-9921-4fa2-8112-f4f64179bdf1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.147230 Dec 15 16:12:59.932260 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 184/412] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:59 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:59.951525 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:59.952119 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:59.958247 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.958688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.959452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.960387 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.092763 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:00.104253 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-809f0f8f-01c2-4c65-8680-ee1efba96c61 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.156154 Dec 15 16:13:00.104859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 229/413] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:59 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:00.293053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:00.293608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:00.299685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.300126 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.300891 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.301313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.434346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:00.441862 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:00.443376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:00.444681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-54d331cf-809e-461d-b4c8-52531b3b809d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.155424 Dec 15 16:13:00.445233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 185/414] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:00 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:00.548710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:00.549552 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:00.556100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.556543 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.557320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.557775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.615320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:00.623315 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-44fd9961-786b-4e48-b8b3-121e8720e30e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1187 microversion: 2.1 time: 0.078149 Dec 15 16:13:00.623879 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 230/415] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:00 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1187 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:00.949504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:00.950218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:00.956229 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.956908 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.957721 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.958149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.099605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:01.107762 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-57fbae76-9e21-406d-b063-93b4bc56de90 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.162529 Dec 15 16:13:01.108332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 186/416] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:00 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:01.122425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:01.123031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:01.129324 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.129815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.130596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.131102 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.347856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:01.356394 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1cf5b46f-abc5-48c2-8557-6f3caafb950c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1363 microversion: 2.1 time: 0.237621 Dec 15 16:13:01.357149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 231/417] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:01 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:01.463667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:01.464390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:01.474829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.476196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.477244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.477840 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.642104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:01.643970 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:01.654213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.655398 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.656502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.657301 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.661235 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:01.672813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:01.676633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:01.679361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-37a804a2-3ddb-476d-bf79-57389be023f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.220512 Dec 15 16:13:01.684022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 187/418] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:01 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:01.928371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:01.936354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2ff555b-04d9-4584-8928-a33b8165f634 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.299622 Dec 15 16:13:01.936978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 232/419] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:01 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:02.124540 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:02.125419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.131179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.131999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.133023 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.133661 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.299445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:02.310810 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6d30d173-9b9a-4c1a-951e-3fd720c76179 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.188400 Dec 15 16:13:02.311884 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 188/420] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:02 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:02.374893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:02.375857 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.383109 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.383855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.384979 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.385635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.587913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-4b6c6a1c-4885-4cd6-ae4e-de98658069ad req-e6e32728-da5e-4b76-b30d-60722a7636e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:02.590005 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:02.590005 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:02.600118 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-4b6c6a1c-4885-4cd6-ae4e-de98658069ad req-e6e32728-da5e-4b76-b30d-60722a7636e2 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.617827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-4b6c6a1c-4885-4cd6-ae4e-de98658069ad req-e6e32728-da5e-4b76-b30d-60722a7636e2 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.633015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-4b6c6a1c-4885-4cd6-ae4e-de98658069ad req-e6e32728-da5e-4b76-b30d-60722a7636e2 service nova] Creating event network-changed:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:13:02.638393 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-4b6c6a1c-4885-4cd6-ae4e-de98658069ad req-e6e32728-da5e-4b76-b30d-60722a7636e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054852 Dec 15 16:13:02.639017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 189/421] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:02.644242 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:02.645423 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.657959 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.658412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.659202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.659634 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.684171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:02.696589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d8088a85-66d3-444e-9e20-5ff48035125a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1549 microversion: 2.1 time: 0.325882 Dec 15 16:13:02.707166 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 233/422] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:02 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1549 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:02.712609 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:02.713250 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.722129 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.722575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.723421 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.723785 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.976117 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:02.985071 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:02.987092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:02.988414 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-92e44f3c-6adf-40b9-b8c0-dc7ca44146e2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347589 Dec 15 16:13:02.988949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-63450256-2985-4901-90fd-37f3bce7cbcf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1742 microversion: 2.20 time: 0.280405 Dec 15 16:13:02.989167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 190/423] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:02 2021] POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:02.989939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 234/424] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:02 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1742 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:02.995854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:02.996519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:03.003861 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:03.004486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.005563 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:03.006208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.013833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:03.014415 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:03.021486 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:03.021863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.023268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:03.023709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.147968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1ad0512e-6ddc-4bbd-b9b1-51bb74a2197b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139483 Dec 15 16:13:03.148577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 191/425] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Dec 15 16:13:02 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:03.329312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:03.330122 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:03.338980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:03.339572 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.340611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:03.341422 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.408192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:03.423576 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4446a8d3-e2ac-4d47-b3e5-8f61f74f311d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.432404 Dec 15 16:13:03.424166 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 235/426] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:02 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:03.483088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:03.490570 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-647c7cbb-ffec-43a1-af96-b7fdef5cf59c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.166363 Dec 15 16:13:03.491228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 192/427] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:03 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:04.012068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:04.012675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.019215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.019666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.020505 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.020940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.434545 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.447430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:04.451573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.453831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.455515 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.456714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5d6efa64-80b6-436d-9812-0b8cdfad0f1f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1742 microversion: 2.20 time: 0.448470 Dec 15 16:13:04.457277 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 236/428] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:04 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1742 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:04.470997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.482004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.482004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.482004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.507705 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:04.508590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.514714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.515384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.516389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.516994 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.640909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.649332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-85c944b9-7047-4190-932d-b6fc6d778acd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.213061 Dec 15 16:13:04.650518 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 193/429] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:04 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:04.805406 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.813761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a5c7bb96-5b05-4552-b092-4212c7ec4a0d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1502 microversion: 2.1 time: 0.310112 Dec 15 16:13:04.815265 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 237/430] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:04 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:04.831213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12ebeb2a-7215-4c65-a2d4-84a427498fb1"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:04.832320 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.838732 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.839182 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.839961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.840611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.864604 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] HTTP exception thrown: Cannot 'attach_volume' instance 4f52daeb-72c4-4375-a19f-7bad854fba4d while it is in vm_state rescued Dec 15 16:13:04.865214 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Returning 409 to user: Cannot 'attach_volume' instance 4f52daeb-72c4-4375-a19f-7bad854fba4d while it is in vm_state rescued {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:13:04.866154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-df4cbe9c-a54b-488b-ae90-ed3fe08f5876 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038706 Dec 15 16:13:04.866749 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 194/431] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:04 2021] POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 16:13:04.875521 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:04.876121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.882899 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.883417 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.884257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.884694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.953373 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d91d1fa5-66d2-445e-ab47-5c5767a1af94 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action" status: 202 len: 0 microversion: 2.1 time: 0.081353 Dec 15 16:13:04.954226 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 238/432] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:04 2021] POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:13:04.962526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:04.963140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.968992 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:04.970142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.970481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.970938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.971734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.972170 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.979596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.980250 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.981208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.981960 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.109589 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.116897 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7f2d6de8-e78b-4bae-ab99-7dbfc8ebb5c9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1510 microversion: 2.1 time: 0.158720 Dec 15 16:13:05.117667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 195/433] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:04 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:05.122200 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-ad39b5f0-9fc6-42e0-a9a7-c86abdc56fc1 req-7890574c-e310-4d36-8773-7f58f6c000c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e", "tag": "22b2ec2e-29af-439e-80e6-b88c63e49caf"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:05.123667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:05.123667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:05.130144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-ad39b5f0-9fc6-42e0-a9a7-c86abdc56fc1 req-7890574c-e310-4d36-8773-7f58f6c000c4 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.130684 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-ad39b5f0-9fc6-42e0-a9a7-c86abdc56fc1 req-7890574c-e310-4d36-8773-7f58f6c000c4 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.142618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-ad39b5f0-9fc6-42e0-a9a7-c86abdc56fc1 req-7890574c-e310-4d36-8773-7f58f6c000c4 service nova] Creating event network-changed:22b2ec2e-29af-439e-80e6-b88c63e49caf for instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e on hv-cinder-80070 Dec 15 16:13:05.147753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-ad39b5f0-9fc6-42e0-a9a7-c86abdc56fc1 req-7890574c-e310-4d36-8773-7f58f6c000c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029088 Dec 15 16:13:05.148635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 196/434] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:05.478993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:05.479679 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:05.487412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.487564 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.488475 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.488977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.630430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.639164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.640754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.641943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-269b8cf3-6126-4838-b601-6870ba77cbfe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1742 microversion: 2.20 time: 0.167798 Dec 15 16:13:05.642506 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 197/435] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:05 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:05.666244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:05.666935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:05.672662 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.673173 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.674034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.674532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.817553 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.824774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dbdbed6b-c42e-40cc-8420-2f03db5e7842 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.162230 Dec 15 16:13:05.825333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 198/436] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:05 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:06.134088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:06.134727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:06.140857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.141299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.142099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.142530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.272781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.280196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bcd9bc99-12eb-43f2-972b-0fbc28a305dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1510 microversion: 2.1 time: 0.149881 Dec 15 16:13:06.280760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 199/437] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:06 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:06.660120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:06.660806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:06.666907 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.667353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.668158 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.668586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.800740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.809034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.810549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.811687 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0620b63e-ff1d-4e1a-af95-0a139b483c5c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1742 microversion: 2.20 time: 0.155547 Dec 15 16:13:06.812235 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 200/438] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:06 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:06.840583 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:06.841183 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:06.846914 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.847359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.848125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.848553 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.986213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.994265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-88fac645-ae96-4514-b961-e573e8718180 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.157054 Dec 15 16:13:06.994835 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 201/439] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:06 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:07.298568 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:07.299164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:07.305929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.306370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.307133 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.307561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.432806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:07.439991 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-725765f4-2f2c-4ebd-b7f0-0cbdd4869839 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1510 microversion: 2.1 time: 0.145017 Dec 15 16:13:07.440555 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 202/440] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:07 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:07.830167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:07.830814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:07.837338 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.837807 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.838584 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.839015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.844294 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c9c43563-e389-4331-8863-8237c9bcb004 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 2.880313 Dec 15 16:13:07.845611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 239/441] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:04 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 2883 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:13:08.015727 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:08.017788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:08.027830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.028638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.030572 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.031262 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.065306 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.077102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.082414 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.083549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-97083874-7cba-4315-9f82-6bb027782f5e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1742 microversion: 2.20 time: 0.257153 Dec 15 16:13:08.084289 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 203/442] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:07 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:08.283966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.293764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d4c6529c-bb42-441e-a773-f0f99a89f1ca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.284255 Dec 15 16:13:08.294637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 240/443] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:08 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:08.456108 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:08.456728 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:08.464996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.464996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.465752 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.466236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.671651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.682011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-89175248-f447-4228-9555-ff19d2f04d18 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1510 microversion: 2.1 time: 0.228505 Dec 15 16:13:08.683105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 204/444] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:08 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:08.857127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:08.858431 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:08.874740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.880454 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.881082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.882117 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.010369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dcac7a48-762d-432a-b8c8-3f73b2c48269 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.157286 Dec 15 16:13:09.011383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 241/445] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:08 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:09.032134 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-29c9b58f-11ee-4f30-8e18-6b52deceda09 req-bf82fc0a-0933-4bc8-8711-7b0573f1ccf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "name": "network-vif-plugged", "status": "completed", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:09.034834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:09.034834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:09.050356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-29c9b58f-11ee-4f30-8e18-6b52deceda09 req-bf82fc0a-0933-4bc8-8711-7b0573f1ccf8 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.050821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-29c9b58f-11ee-4f30-8e18-6b52deceda09 req-bf82fc0a-0933-4bc8-8711-7b0573f1ccf8 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.077408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-29c9b58f-11ee-4f30-8e18-6b52deceda09 req-bf82fc0a-0933-4bc8-8711-7b0573f1ccf8 service nova] Creating event network-vif-plugged:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:13:09.090317 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-29c9b58f-11ee-4f30-8e18-6b52deceda09 req-bf82fc0a-0933-4bc8-8711-7b0573f1ccf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059886 Dec 15 16:13:09.090858 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 205/446] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:09.104006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:09.104700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:09.111847 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.114265 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.116947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.117630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.313821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:09.314595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:09.321283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.326287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.327557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.328208 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.332376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:09.349691 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:09.351945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:09.353620 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-72080929-c5a6-4da9-ade7-59c371f71cb1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.254378 Dec 15 16:13:09.366641 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 242/447] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:09 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:09.617106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:09.627383 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-21da9c04-e130-4b35-9d77-510cf0360bca tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1273 microversion: 2.1 time: 0.317389 Dec 15 16:13:09.628789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 206/448] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:09 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:09.704836 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:09.706258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:09.714842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.715575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.717003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.717638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.890328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85eb15ec-0205-4163-9df6-f82379c1eda3"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:09.891597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:09.902339 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.903746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.907032 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.907940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.024341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.059807 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-17d48de3-6481-4ee9-892b-c33ebbc9bef9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1510 microversion: 2.1 time: 0.363485 Dec 15 16:13:10.066870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 243/449] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:09 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1510 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:10.071348 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] HTTP exception thrown: Invalid volume: volume 85eb15ec-0205-4163-9df6-f82379c1eda3 is already attached to instances: b857430f-d0fd-4457-b7e6-10a1052f95bc Dec 15 16:13:10.072017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Returning 400 to user: Invalid volume: volume 85eb15ec-0205-4163-9df6-f82379c1eda3 is already attached to instances: b857430f-d0fd-4457-b7e6-10a1052f95bc {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:13:10.074242 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1841792e-611e-4b30-88dd-12519b3e0770 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.186790 Dec 15 16:13:10.078232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 207/450] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:09 2021] POST /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:13:10.085253 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:10.088250 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:10.104448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.105825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.108562 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.111166 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.221189 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-41174f20-daad-4613-bce0-e9c5225974da tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.152476 Dec 15 16:13:10.226343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 244/451] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:10 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:10.228247 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:10.229049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:10.238913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.240084 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.242109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.244832 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.373509 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:10.374688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:10.395256 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.396084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.400011 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.401893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.526822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lazy-loading 'services' on Instance uuid b857430f-d0fd-4457-b7e6-10a1052f95bc {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:13:10.630243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.645581 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.647561 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.648988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bc282c14-4fda-4ac9-ad13-3ac01f095c84 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.280232 Dec 15 16:13:10.649887 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 245/452] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:10 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:10.660483 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:10.661558 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:10.673460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.673991 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.674788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.675230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.738702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6a117237-c5a7-4997-a8eb-d894c7d8e3e8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments/85eb15ec-0205-4163-9df6-f82379c1eda3" status: 202 len: 0 microversion: 2.1 time: 0.519343 Dec 15 16:13:10.739424 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 208/453] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:13:10 2021] DELETE /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments/85eb15ec-0205-4163-9df6-f82379c1eda3 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:13:10.762359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:10.764411 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:10.773162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.774150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.775260 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.776073 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.823639 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-db884c63-6a71-4e8f-8465-1cd016de4c20 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068628 Dec 15 16:13:10.824910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 209/454] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:10 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:13:10.871740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.880181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1bf2bb69-493c-433d-9f89-f8656ac524d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.228065 Dec 15 16:13:10.880807 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 246/455] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:10 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:11.083086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:11.083769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:11.091714 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.092217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.093276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.093925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.234550 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:11.235525 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:11.243732 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.244555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.245782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.246743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.258970 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.268316 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-010eaebd-7cb3-4802-8108-983b6c6548d3 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1510 microversion: 2.1 time: 0.188810 Dec 15 16:13:11.269123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 210/456] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:11 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:11.350206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-abcf1cb3-f0d1-4b77-ad75-3acec55b2250 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.119214 Dec 15 16:13:11.351772 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 247/457] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:11 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:11.672071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:11.674542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:11.700312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.701590 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.705677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.706465 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.837273 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:11.838326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:11.848976 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.849477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.851239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.852101 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.885979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.890126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5f916241-26c0-4142-8783-29820a07098f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057663 Dec 15 16:13:11.891317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 248/458] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:11 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:13:11.900452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:11.901106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.901648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:11.903874 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.905915 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b3e1f1d7-d1bd-4f7f-a16d-3ac1736f69ab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.238687 Dec 15 16:13:11.906885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 211/459] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:11 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:11.922779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.922779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.923092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.923756 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.080448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:12.090804 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4074dc67-8c8d-4aab-a12b-b06534379b68 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.195174 Dec 15 16:13:12.091602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 249/460] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:11 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:12.288201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:12.289601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:12.296231 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.296670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.297509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.297974 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.362896 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:12.363833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:12.371560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.372008 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.373141 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.373612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.445139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:12.454674 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-09430f09-8977-4f1e-9571-87eca9411967 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1516 microversion: 2.1 time: 0.170338 Dec 15 16:13:12.455625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 212/461] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:12 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:12.456735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e5285080-54d1-4d78-bb68-f8fe2d3db731 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.098000 Dec 15 16:13:12.457901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 250/462] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:12 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:12.902299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:12.903397 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:12.913475 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.914131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.915079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.915665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.929607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:12.930938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:12.952673 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.953439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.954393 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.954978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.001755 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e70ff824-fc70-4f3b-82f5-b2cf5763cce5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104212 Dec 15 16:13:13.002339 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 213/463] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:12 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:13.108287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:13.108957 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:13.115528 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.116573 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.117491 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.117930 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.165988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.174019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.176103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.179220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c3ae5798-cdaf-459e-b238-1892fc27217a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.255011 Dec 15 16:13:13.190506 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 251/464] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:12 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:13.288967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.298392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2fbbd599-588e-488c-8130-2739a044b87e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.193773 Dec 15 16:13:13.303168 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 214/465] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:13 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:13.468523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:13.470768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:13.480693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.481596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.482569 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.483348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.604266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-beee9236-f4d1-406e-bf28-d5655515647e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.138757 Dec 15 16:13:13.605951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 252/466] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:13 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:13.843928 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:13.845121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:13.859255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.861541 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.863284 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.864373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.014902 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:14.017355 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:14.025903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.026761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.027717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.028386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.070732 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:14.074889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0cad1ad8-2d21-40de-bf0a-2648e7f2af28 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063379 Dec 15 16:13:14.076245 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 253/467] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:14 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:13:14.079469 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1027c7fc-2579-4ad4-8809-6ffb18c2926d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1516 microversion: 2.1 time: 0.239328 Dec 15 16:13:14.080033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 215/468] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:13 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:14.096242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce87978f-53bd-444a-a036-0f73ed651345"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:14.099243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:14.112611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.113351 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.114304 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.114858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.207663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:14.208285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:14.218360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.219035 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.220340 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.221068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.473030 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:14.486364 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:14.488970 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:14.490489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-37e66691-171c-40e9-a49f-703062bdb1c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.293655 Dec 15 16:13:14.498863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 216/469] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:14 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:14.505500 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:14.506469 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:14.514031 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.515262 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.516282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.516979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.552191 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98f2fba0-7cb8-48e9-8cf7-6a9a676d01e5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459610 Dec 15 16:13:14.554257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 254/470] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:14 2021] POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:14.619971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:14.622559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:14.630571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.632279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.633560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.634450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.732715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e245ae08-a883-4de5-8266-ead1c742ebbc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.120070 Dec 15 16:13:14.733425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 255/471] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:14 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:13:14.806686 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:14.816328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-041e21ad-acb3-4b26-b3d0-62b6a8ab3aee tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.316025 Dec 15 16:13:14.817411 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 217/472] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:14 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:15.088291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:15.089692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:15.098607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.099262 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.100848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.101582 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.142895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34e966d1-9380-4b2b-b738-bc99cb5fb4aa tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059844 Dec 15 16:13:15.143953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 256/473] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:15 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:15.518972 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:15.519802 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:15.528728 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.529179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.531273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.531719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.763498 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:15.778626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:15.781155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:15.788537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.789323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.793649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:15.794113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.794718 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.795167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:15.796381 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0497739e-ca1d-4d89-9658-03a9686e01f0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.281099 Dec 15 16:13:15.811511 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 218/474] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:15 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:15.836467 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:15.837233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:15.847204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.848162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.849066 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.852764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.051492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:16.062062 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1722feea-f671-4360-ae71-c2f9f4f3f7d0 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.229888 Dec 15 16:13:16.062863 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c2107f1c-ad56-4e64-808a-49cd58438c86 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.322366 Dec 15 16:13:16.066575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 257/475] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:15 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:16.073446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 219/476] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:15 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:16.156489 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:16.157624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:16.166042 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.166564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.167393 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.167922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.200297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-63df4f90-51dd-465d-8bac-60bd910c0915 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 Dec 15 16:13:16.201075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 258/477] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:16 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:16.820761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:16.821651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:16.839078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.839518 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.840310 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.840738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.997685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.007452 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.014422 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.016180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-033b6780-3782-485c-a2fe-fce3c31b16f3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.201130 Dec 15 16:13:17.017357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 220/478] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:16 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:17.077113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:17.078194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:17.080170 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:17.081529 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:17.087725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.089294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.090735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.092612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.093275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.097271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.104849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.105325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.207038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-63db03a1-a264-4417-b698-d580a7b97f0d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.134092 Dec 15 16:13:17.207859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 259/479] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:17 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:17.214175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:17.215584 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:17.223528 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.227692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.230439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.232558 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.275385 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-229eab1e-7da8-44af-9c80-dba8034b13a1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066025 Dec 15 16:13:17.279824 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 260/480] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:17 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:17.328265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.337274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3a2afda9-2101-45df-a470-9a1b8f978d27 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.261159 Dec 15 16:13:17.337875 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 221/481] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:17 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:18.037051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:18.038329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:18.046817 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.047517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.048552 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.049114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.218485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:18.219311 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.225220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:18.232615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.242229 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.242686 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.243494 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.243928 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.249243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.250567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b62e5ff4-8ea7-45bc-8bcd-82d0439e8d99 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.217847 Dec 15 16:13:18.251177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 261/482] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:18 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:18.290391 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:18.291481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:18.299306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.299745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.300626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.301052 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.360050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e767ef1a-fa29-4c9c-8e93-a9795a72cf59 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074829 Dec 15 16:13:18.361210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 262/483] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:18 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:18.366764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:18.367458 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:18.373935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.374657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.374883 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6c9eef11-b40f-4ba2-b45d-bf0aded7b45b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.159746 Dec 15 16:13:18.375531 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 222/484] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:18 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:18.376142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.376755 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.380599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:18.381291 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:18.390551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.391347 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.392440 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.392938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.539389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.547748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-236b5486-2e9f-49ff-8734-de696fd9a445 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.185196 Dec 15 16:13:18.558559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 263/485] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:18 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:18.568174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.580384 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-555892c3-a698-40c9-8386-3bcd98383fac tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1594 microversion: 2.1 time: 0.203554 Dec 15 16:13:18.581693 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 223/486] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:18 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1594 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:19.274450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:19.275177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:19.285774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.286683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.289274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.289980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.374823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:19.376995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:19.390771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.392361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.394472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.395751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.462617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e8e8ea8e-7661-41d9-8ebe-981e6349c7d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093910 Dec 15 16:13:19.464071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 224/487] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:19 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:13:19.498132 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:19.502608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:19.524431 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.528058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.529004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.529874 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.642059 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:19.654602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:19.656290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:19.657476 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ea7a80ce-10a2-49cc-bb5c-830827c3a283 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.389169 Dec 15 16:13:19.659100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 264/488] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:19 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:19.666720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8ced9be8-9525-4065-b5a5-abfec0128f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.201035 Dec 15 16:13:19.668320 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 225/489] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:19 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:19.672875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:19.673491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:19.680319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.681099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.682270 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.682931 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.754964 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-219747518", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "7d5230c5-6fc8-45a8-89a6-a1e34f97f335"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:19.833240 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] validate_networks() for [('7d5230c5-6fc8-45a8-89a6-a1e34f97f335', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:13:20.056096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:20.072037 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-74484622-7d61-4727-ae97-1b51ce119689 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.411661 Dec 15 16:13:20.073264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 265/490] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:19 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:20.335793 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:13:20.336295 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:13:20.336763 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:13:20.337171 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:13:20.337609 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:13:20.349174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.349652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.350769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.351207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.372038 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:13:20.377622 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Getting quotas for user df09b0b78f6646ed8c520c5c46b3eb58 and project 59432b92e45948e5962f7a60e09135b3. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:13:20.406987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:13:20.409741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:13:20.476625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0e1d4eda-d873-45f0-83db-6ce972f3f4ce tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729434 Dec 15 16:13:20.478263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 226/491] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:13:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:13:20.488026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bbb5073a-9488-4c40-b31d-5c1dc6bf0b27 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:20.488744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bbb5073a-9488-4c40-b31d-5c1dc6bf0b27 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:20.678199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:20.679430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:20.690673 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.691114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.691905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.692345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.805909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2e0e4c51-7426-4a30-b41f-ecab86aabd29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 14 microversion: 2.1 time: 0.131222 Dec 15 16:13:20.809193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 227/492] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:20 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:13:20.811516 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:20.812183 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:20.828282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.828734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.829635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.830092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.879189 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bbb5073a-9488-4c40-b31d-5c1dc6bf0b27 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:20.888642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bbb5073a-9488-4c40-b31d-5c1dc6bf0b27 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1217 microversion: 2.1 time: 0.404520 Dec 15 16:13:20.899087 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 266/493] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:20 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1217 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:21.090176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:21.091419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:21.098381 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.098907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.100175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.101307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.115863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:21.138921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:21.140497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:21.141714 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7f7ba56b-369c-4458-863e-5ab15b2f4b3a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1737 microversion: 2.20 time: 0.333990 Dec 15 16:13:21.142304 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 228/494] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:20 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:21.416654 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:21.423913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-be28c4f3-4e2c-450b-95cc-d02ceebfde93 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.339146 Dec 15 16:13:21.424584 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 267/495] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:21 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:21.611776 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-37d3de03-5388-47a9-a0f0-3c3e5c3f4be8 req-a3212948-3fc7-4713-91ba-ec60da4a7fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:21.613330 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:21.613330 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:21.620723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-37d3de03-5388-47a9-a0f0-3c3e5c3f4be8 req-a3212948-3fc7-4713-91ba-ec60da4a7fc5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.621156 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-37d3de03-5388-47a9-a0f0-3c3e5c3f4be8 req-a3212948-3fc7-4713-91ba-ec60da4a7fc5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.633699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-37d3de03-5388-47a9-a0f0-3c3e5c3f4be8 req-a3212948-3fc7-4713-91ba-ec60da4a7fc5 service nova] Creating event network-changed:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:13:21.639593 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-37d3de03-5388-47a9-a0f0-3c3e5c3f4be8 req-a3212948-3fc7-4713-91ba-ec60da4a7fc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031398 Dec 15 16:13:21.640635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 229/496] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:21.819800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:21.821938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:21.830460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.831118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.832249 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.832741 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.906197 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:21.907301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:21.914610 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.915143 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.916005 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.916533 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.964808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-58462ede-bb35-4975-8cfb-9be95153c106 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 5834 microversion: 2.1 time: 0.151608 Dec 15 16:13:21.969721 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 268/497] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:21 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 5834 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:22.021324 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.031311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-07dcea7e-8367-4a99-a02a-5338ee14ec5d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1269 microversion: 2.1 time: 0.129622 Dec 15 16:13:22.043353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 230/498] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:21 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:22.161687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:22.163200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:22.179096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:22.179855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:22.181062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:22.181752 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:22.441205 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:22.442180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:22.468907 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:22.473325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:22.474308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:22.477221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:22.541211 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.550383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.552352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.555103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-df980794-7104-4180-adb8-4a9c132e54d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1719 microversion: 2.20 time: 0.398109 Dec 15 16:13:22.556347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 269/499] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:22 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1719 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:22.874361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.915019 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b948c50c-3223-4302-941c-cf4d158987ec tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.473615 Dec 15 16:13:22.916489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 231/500] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:22 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:22.981818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:22.987192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.009958 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.010418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.011481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.012269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.051012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:23.058317 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.066917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.067688 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.073610 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.074753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.174040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.185427 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-62864934-f790-4fcd-b4e4-bf80e67192df tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1275 microversion: 2.1 time: 0.137871 Dec 15 16:13:23.187925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 232/501] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:23 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:23.194674 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-c55a6d03-1098-4741-9c65-cfe38ebca914 req-b826f451-7a79-42f5-b0c7-15d4359207ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "name": "network-vif-plugged", "status": "completed", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:23.196194 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:23.196194 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:23.208408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-81224f17-39a4-4bf7-9690-495f9f554a0a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 10893 microversion: 2.1 time: 0.234759 Dec 15 16:13:23.209241 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 270/502] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:22 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 10893 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:23.212323 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c55a6d03-1098-4741-9c65-cfe38ebca914 req-b826f451-7a79-42f5-b0c7-15d4359207ee service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.214273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c55a6d03-1098-4741-9c65-cfe38ebca914 req-b826f451-7a79-42f5-b0c7-15d4359207ee service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.231484 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-c55a6d03-1098-4741-9c65-cfe38ebca914 req-b826f451-7a79-42f5-b0c7-15d4359207ee service nova] Creating event network-vif-plugged:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:13:23.236833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-c55a6d03-1098-4741-9c65-cfe38ebca914 req-b826f451-7a79-42f5-b0c7-15d4359207ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047621 Dec 15 16:13:23.237356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 233/503] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:23.587378 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:23.588630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-718525851"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:23.590496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.593799 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.611280 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.612071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.614761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.615503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.616727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.617345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.620776 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.622092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.822643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.836339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.837986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.839182 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c2c3e973-3013-44c1-ba85-bb1a46f737d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1719 microversion: 2.20 time: 0.267697 Dec 15 16:13:23.839738 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 271/504] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:23 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1719 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:23.935641 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:23.936459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.944240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.944240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.945217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.945692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.103117 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.network.security_group_api [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Adding security group f7344dae-f88c-442d-8a01-50bbb42f0b8f to port 282cd38c-1d07-4bb0-8400-a79f6db5a357 Dec 15 16:13:24.119661 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:24.127453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6574980-2eb2-4f52-a1fc-04ad666223df tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.195436 Dec 15 16:13:24.128439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 272/505] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:23 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:24.204660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:24.205294 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:24.213294 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.214300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.215154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.215587 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.419768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:24.429201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-854d0511-e454-4f6f-886e-f834b4483009 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.228583 Dec 15 16:13:24.430094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 273/506] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:24 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:24.434819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:24.436116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:24.443237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.443731 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.445717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.446310 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.579232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e841054b-2e11-4237-b5a0-c5ad1cc5422c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 15025 microversion: 2.1 time: 0.147614 Dec 15 16:13:24.580798 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 274/507] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:24 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 15025 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:24.736142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8684b500-45c7-4da0-b4e4-6481dae956dc tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/action" status: 202 len: 0 microversion: 2.1 time: 1.154939 Dec 15 16:13:24.736926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 234/508] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:23 2021] POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/action => generated 0 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:13:24.749578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:24.750283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:24.756924 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-6924a84e-dad8-4e3b-8948-58ffd111c1a5 req-ac197820-e1b8-4347-87ef-0ba40d5b0d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:24.760729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:24.760729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:24.767729 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.768172 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.773227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-6924a84e-dad8-4e3b-8948-58ffd111c1a5 req-ac197820-e1b8-4347-87ef-0ba40d5b0d2b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.773856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.774683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.779122 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-6924a84e-dad8-4e3b-8948-58ffd111c1a5 req-ac197820-e1b8-4347-87ef-0ba40d5b0d2b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.817836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-6924a84e-dad8-4e3b-8948-58ffd111c1a5 req-ac197820-e1b8-4347-87ef-0ba40d5b0d2b service nova] Creating event network-changed:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:13:24.832050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-6924a84e-dad8-4e3b-8948-58ffd111c1a5 req-ac197820-e1b8-4347-87ef-0ba40d5b0d2b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084646 Dec 15 16:13:24.834292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 235/509] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:24.865338 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:24.867623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:24.878171 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.878998 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.879955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.880535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.148967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.155033 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.163942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-00948887-d9a6-4bc0-b0cd-07c32d9df817 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1759 microversion: 2.1 time: 0.421695 Dec 15 16:13:25.165663 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 275/510] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:24 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1759 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:25.167660 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.170793 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:25.171567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:25.174429 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.175820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3840a148-85e9-4efa-a09f-340d32802de6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1719 microversion: 2.20 time: 0.322079 Dec 15 16:13:25.180455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 236/511] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:24 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1719 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:25.191317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.192120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.193081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.193704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.451827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:25.452842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:25.465681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.468965 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.470026 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.471535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.472214 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.480268 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f77a15bf-17c6-4129-8ddf-2a14afab2e22 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1261 microversion: 2.1 time: 0.313200 Dec 15 16:13:25.480825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 276/512] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:25 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1261 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:25.591624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:25.592539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:25.599650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.600157 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.601353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.601353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.721893 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.732702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f911b95e-40cb-4dbc-9b79-e3ab1b43becc tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.288271 Dec 15 16:13:25.733277 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 237/513] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:25 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:25.792642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6d0df5eb-8108-46c1-a0da-c1329c110e54 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 16120 microversion: 2.1 time: 0.204706 Dec 15 16:13:25.796838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 277/514] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:25 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 16120 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:26.200013 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:26.200614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.214601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.215270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.216011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.216444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.350232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.354669 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.356165 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.357374 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1bdb3af8-0a69-4e0c-966e-73cf9ad2f11e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1719 microversion: 2.20 time: 0.160990 Dec 15 16:13:26.357972 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 238/515] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:26 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:26.498478 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:26.499812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.512359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.513040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.516081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.516735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.619882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:26.620874 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.627010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.627476 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.628243 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.628681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.652719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lazy-loading 'flavor' on Instance uuid 4f52daeb-72c4-4375-a19f-7bad854fba4d {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:13:26.666897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.674190 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e258395d-11cc-4841-8f6e-d1eda7be905e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1445 microversion: 2.1 time: 0.179871 Dec 15 16:13:26.674750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 278/516] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:26 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:26.690629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:26.691964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.698316 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.698763 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.699527 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.700128 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.779399 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7fc36d2e-9a6f-46eb-9e3d-f334de09471b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action" status: 200 len: 32 microversion: 2.1 time: 0.162133 Dec 15 16:13:26.780029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 239/517] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:26 2021] POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:13:26.790245 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:26.790948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.797024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.797502 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.798309 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.798734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.849370 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.861082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6a836d28-0d10-4960-b0a7-0d7dc8332f85 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1445 microversion: 2.1 time: 0.174103 Dec 15 16:13:26.861715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 279/518] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:26 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:26.877691 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:26.878508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.885500 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.886359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.887454 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.888047 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.986695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.995599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ca9bba02-23a4-4a29-88cb-9cde397b365d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.210205 Dec 15 16:13:26.996420 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 240/519] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:26 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:27.001152 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:27.002515 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:27.008895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.009633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.010587 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.011179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.145731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-79d8313a-3ca2-46da-8a50-0a8d7876f881 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 17602 microversion: 2.1 time: 0.148007 Dec 15 16:13:27.146525 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 241/520] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:26 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 17602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:27.152579 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-80c447a3-dc35-48e6-8b06-d5aea31c1cbf req-f8f44dbd-4ff1-4e84-9ddb-9ab147b73301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e519bc0-2a60-4c36-944b-0ee53a0f84fa", "tag": "97f94f22-81f2-4990-ae11-e57a8f1e6d91"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:27.154662 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:27.154662 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:27.163305 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-80c447a3-dc35-48e6-8b06-d5aea31c1cbf req-f8f44dbd-4ff1-4e84-9ddb-9ab147b73301 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.163967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-80c447a3-dc35-48e6-8b06-d5aea31c1cbf req-f8f44dbd-4ff1-4e84-9ddb-9ab147b73301 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.176448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-80c447a3-dc35-48e6-8b06-d5aea31c1cbf req-f8f44dbd-4ff1-4e84-9ddb-9ab147b73301 service nova] Creating event network-changed:97f94f22-81f2-4990-ae11-e57a8f1e6d91 for instance 6e519bc0-2a60-4c36-944b-0ee53a0f84fa on hv-cinder-80070 Dec 15 16:13:27.182595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-80c447a3-dc35-48e6-8b06-d5aea31c1cbf req-f8f44dbd-4ff1-4e84-9ddb-9ab147b73301 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 Dec 15 16:13:27.183825 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 242/521] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:27.188691 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-f56a44fb-d2ab-46c9-aee4-2b017c23240a req-09e5be6c-056c-4d9a-9f12-3c5844c4f83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "name": "network-vif-unplugged", "status": "completed", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:27.190201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:27.190201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:27.198582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f56a44fb-d2ab-46c9-aee4-2b017c23240a req-09e5be6c-056c-4d9a-9f12-3c5844c4f83a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.199273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f56a44fb-d2ab-46c9-aee4-2b017c23240a req-09e5be6c-056c-4d9a-9f12-3c5844c4f83a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.210260 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:27.215138 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-f56a44fb-d2ab-46c9-aee4-2b017c23240a req-09e5be6c-056c-4d9a-9f12-3c5844c4f83a service nova] Creating event network-vif-unplugged:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:13:27.221432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0e6764d-c10e-44e9-8559-4c445d3c5275 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.347212 Dec 15 16:13:27.222737 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 280/522] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:26 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:27.231883 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-f56a44fb-d2ab-46c9-aee4-2b017c23240a req-09e5be6c-056c-4d9a-9f12-3c5844c4f83a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045154 Dec 15 16:13:27.233275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 243/523] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:27.377532 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:27.388965 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:27.399111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.405699 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.406918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.407380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.574702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:27.583029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:27.584558 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:27.585804 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c5bcc420-91c5-4113-9a5e-9b06b2aa790a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1722 microversion: 2.20 time: 0.211990 Dec 15 16:13:27.586361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 281/524] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:27 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:27.605510 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bab1bc7-b42d-4d47-b984-596ab8dd67c0"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:27.606772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:27.613237 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.613711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.614594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.614946 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.899953 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-752f633e-f218-4601-97c7-8eaced78e043 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299741 Dec 15 16:13:27.900960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 244/525] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Dec 15 16:13:27 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:28.012263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:28.013014 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:28.018935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.019521 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.019869 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:28.020490 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:28.020658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.021205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.031535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.031996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.033485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.033936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.138935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-542a75f9-4f59-439c-b6f9-e84b7d490afc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action" status: 202 len: 0 microversion: 2.20 time: 0.126360 Dec 15 16:13:28.140070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 245/526] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:13:28 2021] POST /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:13:28.150671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:28.152846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:28.159435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.159878 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.160658 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.161309 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.178944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.187915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8213d315-ee0b-41c3-800c-3da7f7c632c2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.179598 Dec 15 16:13:28.197916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 282/527] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:28 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:28.212990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:28.213700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:28.219860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.220318 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.221111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.221583 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.307707 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d545c7f-2a89-40c3-a7c6-8f868404e0bb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 17602 microversion: 2.1 time: 0.098623 Dec 15 16:13:28.308342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 283/528] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:28 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 17602 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:28.313730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:28.314233 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:28.323537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.323994 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.324961 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.325601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.471460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.484040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c22b23e-a6bd-471e-9c6a-406ec0086f9a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.174175 Dec 15 16:13:28.484855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 284/529] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:28 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:28.707479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.717271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.718873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.720157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a1f7817f-9ba5-4d93-ba66-6067e5c77bca tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1748 microversion: 2.20 time: 0.573685 Dec 15 16:13:28.721187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 246/530] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:28 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1748 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:29.217365 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:29.218601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:29.230877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.231725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.232846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.233354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.319316 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:29.320612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:29.326405 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.327048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.328157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.328749 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.394272 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:29.403756 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e25f9ed1-06ae-40b5-bab9-d57c47efa500 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.192211 Dec 15 16:13:29.404326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 285/531] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:29 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:29.437130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a8ca672e-be6b-432b-aacc-f4efeef070aa tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 19399 microversion: 2.1 time: 0.121010 Dec 15 16:13:29.438184 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 247/532] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:29 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 19399 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:29.502560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:29.503313 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:29.509939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.510546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.511553 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.512050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.643494 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-3aca0158-360c-4344-bd8d-33cb1302f95b req-f28c406f-c702-4fad-ba18-9dbede58f4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:29.644997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:29.644997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:29.653753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-3aca0158-360c-4344-bd8d-33cb1302f95b req-f28c406f-c702-4fad-ba18-9dbede58f4b5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.654488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-3aca0158-360c-4344-bd8d-33cb1302f95b req-f28c406f-c702-4fad-ba18-9dbede58f4b5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.667549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-3aca0158-360c-4344-bd8d-33cb1302f95b req-f28c406f-c702-4fad-ba18-9dbede58f4b5 service nova] Creating event network-changed:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:13:29.673012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-3aca0158-360c-4344-bd8d-33cb1302f95b req-f28c406f-c702-4fad-ba18-9dbede58f4b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033820 Dec 15 16:13:29.677813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 248/533] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:13:29.683358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:29.691383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-290417f3-494e-4086-b078-8581a0eb2735 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.192611 Dec 15 16:13:29.692176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 286/534] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:29 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:29.739583 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:29.740296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:29.746504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.746948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.747732 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.748155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.003661 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.014748 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.016244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.017455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b12a42ad-1f52-4581-93dc-045204fc046a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1750 microversion: 2.20 time: 0.282307 Dec 15 16:13:30.018140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 249/535] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:29 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1750 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:30.421852 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:30.422469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:30.429685 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.430131 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.430918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.431378 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.448583 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:30.449720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:30.456250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.456897 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.458003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.458592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.557785 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b218335e-79b8-4e68-868f-0bd7095cdd26 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 21438 microversion: 2.1 time: 0.113247 Dec 15 16:13:30.558432 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 250/536] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:30 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 21438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:30.567851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.575848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-040e7caf-f173-42fb-ad49-02abe883e9f7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.157568 Dec 15 16:13:30.576419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 287/537] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:30 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:30.709952 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:30.710639 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:30.717697 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.718141 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.718927 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.719355 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.934554 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.942150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c9ea43a5-cced-43d7-8060-a8a9cb6afc50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.236233 Dec 15 16:13:30.942709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 251/538] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:30 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:31.037616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:31.038935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:31.045575 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.046027 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.046808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.047232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.177343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.185778 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.187269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.188459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bbba9b2e-252e-4f02-bfa3-1a6782230d20 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.154884 Dec 15 16:13:31.189024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 288/539] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:31 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:31.568537 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:31.570139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:31.577023 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.577503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.578290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.578727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.593854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:31.594391 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:31.601323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.601812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.602611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.603049 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.678749 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6e9c0cc0-7e73-4bc7-8f28-434b349ea726 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 22763 microversion: 2.1 time: 0.112754 Dec 15 16:13:31.679559 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 252/540] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:31 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 22763 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:31.738452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.746172 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-306fa1f7-d665-47f8-b596-271327273e2e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.156112 Dec 15 16:13:31.746769 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 289/541] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:31 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:31.966986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:31.969360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:31.978842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.979384 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.980254 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.980937 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.150983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:32.160309 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4de19a54-dc31-4dea-8c97-f878cf4aa5dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.202664 Dec 15 16:13:32.161138 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 253/542] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:31 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:32.206953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:32.207567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:32.214417 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.214865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.215702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.216148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.365776 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:32.376075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:32.387335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:32.388537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b77bf5a7-ba5b-48e1-8201-08c5dc16ba34 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.185296 Dec 15 16:13:32.389103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 290/543] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:32 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:32.689879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:32.690945 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:32.697372 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.697850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.698626 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.699058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.763525 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:32.764194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:32.771384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.771847 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.778468 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.778909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.930453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:32.937691 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0cb0ac5-5d30-476c-aba3-b9e30d0376b1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.178309 Dec 15 16:13:32.938349 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 291/544] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:32 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:33.070358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c672dde7-3f44-4782-b8f6-eb1a6451efe5 req-1538b18a-cc30-4d55-89fd-296a9dde91b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e519bc0-2a60-4c36-944b-0ee53a0f84fa", "name": "network-vif-plugged", "status": "completed", "tag": "97f94f22-81f2-4990-ae11-e57a8f1e6d91"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:33.072304 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:33.072304 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:13:33.080173 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c672dde7-3f44-4782-b8f6-eb1a6451efe5 req-1538b18a-cc30-4d55-89fd-296a9dde91b5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.080713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c672dde7-3f44-4782-b8f6-eb1a6451efe5 req-1538b18a-cc30-4d55-89fd-296a9dde91b5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.107140 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c672dde7-3f44-4782-b8f6-eb1a6451efe5 req-1538b18a-cc30-4d55-89fd-296a9dde91b5 service nova] Creating event network-vif-plugged:97f94f22-81f2-4990-ae11-e57a8f1e6d91 for instance 6e519bc0-2a60-4c36-944b-0ee53a0f84fa on hv-cinder-80070 Dec 15 16:13:33.114022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c672dde7-3f44-4782-b8f6-eb1a6451efe5 req-1538b18a-cc30-4d55-89fd-296a9dde91b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047537 Dec 15 16:13:33.114686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 292/545] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:33.177917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:33.178957 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:33.185028 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.185534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.186307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.186751 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.351195 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.359292 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6eb087bc-914f-4108-adc5-0943db117188 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.185314 Dec 15 16:13:33.359915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 293/546] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:33 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:33.408291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:33.408923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:33.415595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.416034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.416807 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.417241 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.548670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.557810 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.559297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.560457 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e529cd23-a3c7-415d-9c77-184e1c3193f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.156077 Dec 15 16:13:33.561433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 294/547] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:33 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:33.954278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:33.954945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:33.961180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.961660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.962438 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.962870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.094570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.102218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-68ea9756-e164-4734-a2df-0f7472f0dad1 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.151571 Dec 15 16:13:34.102787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 295/548] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:33 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:34.379501 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:34.380095 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:34.386377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.386825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.387606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.388045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.531680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.541502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7117ef19-7e16-4911-974a-5eaf98f1ca1a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.165628 Dec 15 16:13:34.542088 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 296/549] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:34 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:34.578903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:34.579537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:34.586444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.586895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.587670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.588108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.722168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.732003 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.733948 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.735829 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2f8631f5-2623-4cae-9a26-cd26b409f7fd tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.160332 Dec 15 16:13:34.736690 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 297/550] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:34 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:35.118479 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:35.119140 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.125264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.125746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.126526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.126971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.255092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.263132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-42b676a2-b423-4272-8647-5dd208573430 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.148731 Dec 15 16:13:35.263701 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 298/551] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:35 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:35.558426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:35.559027 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.565094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.565573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.566343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.566774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.707754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.718516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d47b0fc1-5be6-4dfc-bad4-83f521a98639 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.163587 Dec 15 16:13:35.719110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 299/552] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:35 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:35.759826 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:35.769400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.769400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.769400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.769400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.769792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.941790 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.958695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.960530 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.961760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ee66ae6c-da81-4b97-bc83-6fa0d8629376 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.206992 Dec 15 16:13:35.962539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 300/553] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:35 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:36.279700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:36.280388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:36.286635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.287074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.288392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.288825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.426658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:36.443453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-62abf914-84e8-4a30-9aff-57b132d5cea9 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.167360 Dec 15 16:13:36.453058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 301/554] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:36 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:36.735764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:36.736386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:36.742298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.742747 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.743516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.743948 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.877261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:36.887274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-265fdb24-ad71-4d9f-9913-7484e573f62a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.155110 Dec 15 16:13:36.887858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 302/555] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:36 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:36.980554 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:36.981160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:36.989892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.990340 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.991813 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.992318 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.123858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.132996 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.134432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.135570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-83b44a46-6cff-4809-81db-5375823a7ca7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.158719 Dec 15 16:13:37.136125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 303/556] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:36 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:37.461023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:37.461694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:37.467781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.468216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.468979 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.469425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.613539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.621149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bcac6695-0bc6-4a79-b5e8-b72347dc954d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.164479 Dec 15 16:13:37.623679 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 304/557] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:37 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:37.905691 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:37.906314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:37.915962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.916407 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.917232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.917715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.056013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.065356 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0ad0f742-2f30-4126-94d3-37cd09ed91fe tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.164500 Dec 15 16:13:38.065962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 305/558] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:37 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:38.153352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:38.153978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:38.160072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.160452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.161226 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.161683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.309894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.318689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.320392 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.321599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2ee075d-d523-4a07-9e66-73d00ff3be19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.171875 Dec 15 16:13:38.322165 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 306/559] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:38 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:38.638751 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:38.639716 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:38.645918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.646362 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.647836 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.648432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.782111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.790167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3dc38a65-33f1-4c9d-8321-afa8555b01a2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.155137 Dec 15 16:13:38.790724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 307/560] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:38 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:39.094872 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:39.095485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:39.102210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.102666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.103456 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.103891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.253877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.262146 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5d6ea1ee-ae2b-414b-89fb-9664421115f1 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.170924 Dec 15 16:13:39.262894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 308/561] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:39 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:39.339709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:39.340314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:39.346167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.346605 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.347369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.347798 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.479977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.487964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.489466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.490709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cf90a19c-00c0-4de6-bbc7-73f8303fd196 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.154612 Dec 15 16:13:39.491806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 309/562] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:39 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:39.806986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:39.807722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:39.815345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.815792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.816664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.817091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.967062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.974232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-16413f79-0d27-4cbd-8e5e-8f59a4660f1d tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.171379 Dec 15 16:13:39.974791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 310/563] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:39 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:40.278982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:40.279579 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:40.285569 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.286010 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:40.286768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.287198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:40.415771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:40.423398 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-30ae59ba-bd54-4e0e-a378-dd261e771bf7 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.148147 Dec 15 16:13:40.423955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 311/564] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:40 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:40.519330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:40.520043 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:40.537201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.537756 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:40.538629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.539050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:40.689904 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:40.699029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:40.700529 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:40.701710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-10541cb7-da2c-417b-a561-d7b8214a666f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.191155 Dec 15 16:13:40.702280 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 312/565] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:40 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:40.991281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:40.992229 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:40.998485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.998935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:40.999714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:41.000150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:41.133538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.141194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-456defed-6bec-449e-997f-8b8ab1fb8e17 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.154111 Dec 15 16:13:41.143024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 313/566] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:40 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:41.440364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:41.440964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:41.446812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:41.447257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:41.448037 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:41.448472 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:41.578963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.587302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4634d817-0195-455f-a2e5-f023c8ea62fc tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.150655 Dec 15 16:13:41.587871 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 314/567] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:41 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:41.720374 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:41.720966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:41.730875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:41.731348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:41.732333 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:41.732881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:41.874117 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.882228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.883727 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.884875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c5fb72e9-8999-403b-b258-3e27d58d17c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.168304 Dec 15 16:13:41.885451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 315/568] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:41 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:42.160373 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:42.161064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:42.167863 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.168315 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.169099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.169570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.304695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:42.311778 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb224e9d-dd11-48ef-9808-8672858372a8 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.155322 Dec 15 16:13:42.312341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 316/569] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:42 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:42.604502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:42.605111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:42.610967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.611410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.612187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.612648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.762857 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:42.770796 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5e795ee9-38ec-4ea2-ad54-fc871d2efaad tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.170476 Dec 15 16:13:42.771371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 317/570] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:42 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:42.903055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:42.903571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:42.909951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.910391 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.911162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.911587 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.041395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.050555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.052078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.054215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1446fe35-e53e-4166-8fc1-10aed1698574 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.154040 Dec 15 16:13:43.058876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 318/571] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:42 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:43.328049 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:43.328742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:43.334846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:43.335286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.336045 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:43.336469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.483007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.491074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a7726039-9999-4b79-99c4-a127995e45cd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.166491 Dec 15 16:13:43.491882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 319/572] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:43 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:43.792685 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:43.793215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:43.799199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:43.799649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.800434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:43.800866 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.932882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.940568 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dd885598-cc0a-48d2-839d-730f35b0144e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.151635 Dec 15 16:13:43.941135 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 320/573] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:43 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:44.073483 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:44.074091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:44.080114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.080860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.082279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.083054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.234269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.243422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.244869 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.246064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3c52ab47-e50b-407e-8683-7602506bb5c4 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.176336 Dec 15 16:13:44.246628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 321/574] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:44 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:44.507880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:44.508642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:44.514773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.515168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.515946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.516376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.655988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.664687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1711a772-4d5b-47c1-af81-286c1e614b61 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.160428 Dec 15 16:13:44.674460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 322/575] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:44 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:44.958273 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:44.960945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:44.968043 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.968853 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.969995 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.970524 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.104760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.112643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2dee484e-025a-41d2-bc03-25813c1c3498 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.158529 Dec 15 16:13:45.113219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 323/576] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:44 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:45.264073 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:45.264595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:45.270547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:45.270989 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.271757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:45.272219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.415189 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.423453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.424970 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.426151 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-15bf4f5c-b29c-424e-b5ba-e46968dba529 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.166006 Dec 15 16:13:45.426721 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 324/577] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:45 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:45.681932 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:45.682630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:45.689348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:45.689909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.691451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:45.691884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.824930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.832063 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dd4d4b34-8962-4d46-aa5f-1fa83035d8b6 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.154361 Dec 15 16:13:45.832635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 325/578] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:45 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:46.132313 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:46.132926 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:46.139084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.139590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.140375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.140805 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.271159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.279552 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-abc31159-1af1-4ae5-8a9c-5d7f60830fce tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.152527 Dec 15 16:13:46.280106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 326/579] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:46 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:46.445327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:46.446121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:46.452345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.453179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.454005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.454438 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.643655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.652433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.654013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.655557 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e8757452-5e53-401d-91c0-bbfffd1796ec tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.214889 Dec 15 16:13:46.655919 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 327/580] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:46 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:46.731979 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:46.733092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:46.739305 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.739744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.740540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.741544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.814799 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b172ae06-b662-4092-a43d-c8babee9038d tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/action" status: 202 len: 0 microversion: 2.1 time: 0.086585 Dec 15 16:13:46.815423 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 328/581] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:46 2021] POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:13:46.823654 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:46.824333 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:46.830291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.830726 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.831492 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.831917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.001670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:47.010445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a72064c0-0ed7-4af4-8d08-1e331e4ffe48 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1751 microversion: 2.1 time: 0.190495 Dec 15 16:13:47.012465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 329/582] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:46 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:47.015372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:47.015975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:47.021842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.023067 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.024007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.024447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.163573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:47.171285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2e8316bb-e218-4c0b-b2b9-371b0508bf83 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.159250 Dec 15 16:13:47.171786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 330/583] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:47 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:47.295704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:47.296306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:47.302164 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.302602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.303881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.304306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.442567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:47.450818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-abdad9f1-c31a-40da-8039-6079ffde0836 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.158724 Dec 15 16:13:47.451383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 331/584] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:47 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:47.674683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:47.675295 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:47.681913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.682359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.683132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.683562 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.814405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:47.822447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:47.823935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:47.825082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-86133a6e-d8ea-4813-8997-af109bfcb6e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.154124 Dec 15 16:13:47.825675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 332/585] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:47 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:48.028221 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:48.028803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:48.034801 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.035246 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.036017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.036450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.175827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:48.184310 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb701d1b-6b21-4bc5-8c15-d31df5eb4f29 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1751 microversion: 2.1 time: 0.159735 Dec 15 16:13:48.184888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 333/586] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:48 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:48.189410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:48.190005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:48.195606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.196053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.196818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.197248 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.337259 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:48.345364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-119dfd80-1bfb-48d7-ac07-8cb05655a702 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.159405 Dec 15 16:13:48.346592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 334/587] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:48 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:48.363869 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-46ede7e2-49cb-4862-a478-fd53a7019a82 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 15.677517 Dec 15 16:13:48.364771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 254/588] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:32 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 15679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:48.467683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:48.468293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:48.474336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.474784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.476206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.476638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.699798 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:48.707638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-668c037e-e5c5-471b-a29d-faa9286ded53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.243693 Dec 15 16:13:48.708256 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 335/589] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:48 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:48.843753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:48.844371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:48.851801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.852239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.853005 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.853451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.201714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:49.202503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:49.211781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.211781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.212858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.213455 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.293154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.302011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.304592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.306052 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fef5c033-662f-48d0-93b9-e3be0f01fbf5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.466386 Dec 15 16:13:49.306721 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 255/590] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:48 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:49.369913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.370487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:49.371681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:49.381570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-650abf01-ee46-4dfc-9598-c5df182d7232 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1751 microversion: 2.1 time: 0.183586 Dec 15 16:13:49.383392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.384460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.386466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.387488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.391601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 336/591] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:49 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:49.396200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:49.397416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:49.403631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.404085 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.404932 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.405367 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.514347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e39d5a0c-bb7e-4085-a6b9-4ade6e0ce3b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.121425 Dec 15 16:13:49.515231 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 337/592] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:49 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:49.549253 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.557287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dfba65e9-adaa-495b-b901-690ce41a3278 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1317 microversion: 2.1 time: 0.195703 Dec 15 16:13:49.558418 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 256/593] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:49 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:49.726242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:49.726745 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:49.733489 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.733931 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.734696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.735124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.868574 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.876281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb18a4de-efce-4bbf-b4e6-c3f58dca1d42 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.154913 Dec 15 16:13:49.876839 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 338/594] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:49 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:50.323855 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:50.324421 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.330723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.331174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.331955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.332390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.398464 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:50.399041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.410016 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.410208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.410939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.414388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.496946 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.505653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.507671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.509083 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-86593bba-5cfc-4d22-8987-d1993e029fa1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.188987 Dec 15 16:13:50.509922 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 257/595] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:50 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:50.526504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:50.527479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.533596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.534051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.534833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.535268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.574332 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.582203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8df8f30a-8fb4-49a6-9674-3573b1a725b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.187884 Dec 15 16:13:50.582761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 339/596] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:50 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:50.587901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:50.588495 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.593957 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.594404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.595173 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.595635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.618215 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3b69df67-c99a-42ba-8626-28bc3762f8be tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.095796 Dec 15 16:13:50.618862 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 258/597] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:50 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:50.724952 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.732673 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f48dd12a-9602-4c53-b08a-29e83c3f3697 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1507 microversion: 2.1 time: 0.148967 Dec 15 16:13:50.733235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 340/598] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:50 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:50.894053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:50.894746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.904637 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.905356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.906153 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.906586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.072148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.079872 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2bf91001-7f4f-4c13-89b8-fb74414dc80b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.190134 Dec 15 16:13:51.080448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 259/599] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:50 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:51.529109 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:51.529742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:51.536559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.537034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.538522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.539150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.599966 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:51.601272 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:51.607595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.608069 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.609060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.609526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.671922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.680509 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.682038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.683189 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d810f602-f237-433c-b609-1de536a6a631 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.158232 Dec 15 16:13:51.683749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 341/600] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:51 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:51.687991 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:51.688943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:51.695331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.695783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.696566 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.697031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.754292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.762995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a30bab31-4690-4a95-9b24-4184c3b4f3b9 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.166606 Dec 15 16:13:51.763569 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 260/601] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:51 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:51.765184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b1a65b5d-e7da-4eeb-a43b-f78e0161be1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.080191 Dec 15 16:13:51.766604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 342/602] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:51 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:52.071220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158a1ef6-04bf-4cc1-beae-622918c458d7"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:52.072334 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:52.078753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.079198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.079976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.080410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.096724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:52.097435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:52.105212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.105686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.106485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.106916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.239220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.248167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c8556d17-80ff-4d06-bd38-0d00f6f49f6e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.155344 Dec 15 16:13:52.248736 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 343/603] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:52 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:13:52.322864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d0166580-5465-416b-ad8b-e92af5b0145b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "POST /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255907 Dec 15 16:13:52.323652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 261/604] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:52 2021] POST /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:52.702041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:52.702640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:52.708810 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.709246 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.710633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.711068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.778614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:52.779677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:52.786295 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.786754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.788205 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.788709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.846803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.854819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.856288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.857489 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0fab1329-a602-4bcf-a379-6a6cf5b518e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.159113 Dec 15 16:13:52.858026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 344/605] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:52 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:52.862346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:52.862938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:52.868520 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.868964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.869761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.870183 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.873163 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-83e71a4c-e110-46ff-9915-ccc5f6e570c3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.099601 Dec 15 16:13:52.874167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 262/606] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:52 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:53.017980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:53.025827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0266e968-e51a-4959-96b7-11c4b535fd62 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.166812 Dec 15 16:13:53.026375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 345/607] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:52 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:53.265637 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:53.266250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:53.273790 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.274275 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.275053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.275487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.408595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:53.417827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b0f1f8ab-c492-4ef0-a05a-01d53515da50 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.156308 Dec 15 16:13:53.418389 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 263/608] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:53 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:53.875736 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:53.876377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:53.883555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.883999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.884782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.885212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.885713 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:53.886653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:53.892497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.892942 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.893739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.894172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.986726 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d8f4c10f-f051-4b78-bbd5-a946de3a61b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.105306 Dec 15 16:13:53.990307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 264/609] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:53 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:54.022353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.030533 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.032040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.033179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f61feb38-e196-4eb4-86bb-0267fbae5213 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.161333 Dec 15 16:13:54.034017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 346/610] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:53 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:54.043243 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:54.043763 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:54.050617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:54.051056 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:54.051938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:54.052375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:54.196190 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.203918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-684a993b-f6ee-4ab7-82c3-e35c07ee436a tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.164822 Dec 15 16:13:54.204478 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 265/611] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:54 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:54.435870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:54.435999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:54.442229 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:54.442695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:54.443465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:54.444405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:54.571031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.578713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c6dedee8-2783-4cb9-8bed-69d3ad855121 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.147727 Dec 15 16:13:54.579284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 347/612] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:54 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:54.997752 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:54.998630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:55.004809 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.005244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.006034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.006738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.051434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:55.052037 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:55.058491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.058928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.059698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.060125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.110250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8cce9bfe-bd39-4ad4-bc15-6415cbe69c6c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.116009 Dec 15 16:13:55.111260 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 266/613] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:54 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:55.189664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.198145 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.199644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.200779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d568e008-54da-460d-bff7-b01e7b035545 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.153013 Dec 15 16:13:55.201330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 348/614] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:55 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:55.222046 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:55.222735 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:55.230111 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.230592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.231361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.231789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.377461 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.385104 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5bf58604-7682-4c00-ab01-ffac639ae8b4 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.167011 Dec 15 16:13:55.385708 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 267/615] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:55 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:55.595938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:55.596541 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:55.603143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.603578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.604360 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.604782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.731830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.739527 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-50ae86d6-0d2d-4e1c-8ef9-c97c0717c7d4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.147250 Dec 15 16:13:55.740089 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 349/616] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:55 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:56.121823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:56.122734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:56.128936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.129380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.130193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.130619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.213500 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a98b097b-d725-4df3-8e26-fe5fcf864798 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.095164 Dec 15 16:13:56.214128 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 268/617] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:56 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:56.219488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:56.220098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:56.226613 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.227088 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.227868 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.228302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.354814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.363078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.364578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.366336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bd206897-beb0-477c-ad3d-92bfce8afa79 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.149945 Dec 15 16:13:56.367281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 350/618] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:56 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:56.402537 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:56.403236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:56.410299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.410741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.411515 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.411940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.559342 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.566864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2d254cda-1a3d-4333-9f90-e458cfe2b627 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.168372 Dec 15 16:13:56.567424 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 269/619] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:56 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:56.756900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:56.757516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:56.763336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.763786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.764555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.764986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.892839 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.900563 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e32add26-24d3-471e-8be0-4560de849d53 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.147349 Dec 15 16:13:56.901123 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 351/620] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:56 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:57.225903 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:57.226829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:57.233144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.233633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.234445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.234879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.337510 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2914c1bf-d9d3-4369-a2aa-b995415f7299 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 28637 microversion: 2.1 time: 0.115801 Dec 15 16:13:57.338417 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 270/621] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:57 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 28637 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:57.385026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:57.385595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:57.391943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.392436 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.393214 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.393677 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.520216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:57.528958 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:57.530505 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:57.531648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7f9dd200-edcc-47e1-8f44-ff8b4379f6f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.150819 Dec 15 16:13:57.532203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 352/622] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:57 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:57.584225 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:57.585633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:57.592552 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.592994 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.593796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.594220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.741692 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:57.749479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d70086e0-0658-4385-8aad-d5877618f1c6 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.169202 Dec 15 16:13:57.750048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 271/623] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:57 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:57.917518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:57.918121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:57.923968 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.924412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.925180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.925646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.056165 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:58.064086 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b8d9c830-0f6f-4def-bf86-8c5aec2645cb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.150236 Dec 15 16:13:58.064649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 353/624] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:57 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:58.349131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:58.350869 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:58.357007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:58.357475 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.358245 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:58.358668 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.462999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c21bfd3-dd2a-4a50-bf32-6e9f19c0675f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 29512 microversion: 2.1 time: 0.117340 Dec 15 16:13:58.463709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 272/625] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:58 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 29512 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:58.550408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:58.551016 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:58.557966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:58.558417 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.559291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:58.559726 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.693312 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:58.702150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:58.703871 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:58.705036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-67e0c86a-56cc-48bf-b314-c77d90a1a7c1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.158353 Dec 15 16:13:58.705629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 354/626] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:58 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:58.767664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:58.768513 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:58.775390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:58.775827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.776619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:58.777045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:58.923883 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:58.931953 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-df3eee23-f62d-4f02-a7b0-a04fc2686e70 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.168319 Dec 15 16:13:58.932508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 273/627] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:58 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:59.081659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:59.082797 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:59.089907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.091144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.092198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.092912 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.180588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-00f527fe-601e-42cc-be1c-b1f1711097c4 req-89ca6dd0-2d3f-408e-bc4e-8108ac4445d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "name": "network-vif-plugged", "status": "completed", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:59.182187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:59.182187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:13:59.193909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-00f527fe-601e-42cc-be1c-b1f1711097c4 req-89ca6dd0-2d3f-408e-bc4e-8108ac4445d5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.195334 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-00f527fe-601e-42cc-be1c-b1f1711097c4 req-89ca6dd0-2d3f-408e-bc4e-8108ac4445d5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.217919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-00f527fe-601e-42cc-be1c-b1f1711097c4 req-89ca6dd0-2d3f-408e-bc4e-8108ac4445d5 service nova] Creating event network-vif-plugged:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:13:59.229036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-00f527fe-601e-42cc-be1c-b1f1711097c4 req-89ca6dd0-2d3f-408e-bc4e-8108ac4445d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056906 Dec 15 16:13:59.229777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 274/628] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:13:59.231623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:59.239529 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-67ca3022-d243-4be0-9a09-acb6808fe388 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.162258 Dec 15 16:13:59.240099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 355/629] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:59 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:59.475983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:59.476933 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:59.483328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.483769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.484530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.484956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.577915 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d5e0c32d-2eef-4877-9ba6-74c09be61824 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 31615 microversion: 2.1 time: 0.106461 Dec 15 16:13:59.578567 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 275/630] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:59 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 31615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:59.723034 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:59.723734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:59.730410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.731010 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.731654 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.741734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.894055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:59.902990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:59.904621 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:59.905982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-afea3bb4-e642-4b97-90ed-78cfce679f33 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.186834 Dec 15 16:13:59.906619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 356/631] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:59 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:59.916276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:59.916853 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:59.923801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.924246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.925016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.925496 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.949811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:59.950425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:59.956404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.956962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.957929 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.958431 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.008614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lazy-loading 'services' on Instance uuid 6e519bc0-2a60-4c36-944b-0ee53a0f84fa {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:00.077909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-92840484-ac1b-4790-9ea9-2a9a8b7bb410 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments/158a1ef6-04bf-4cc1-beae-622918c458d7" status: 202 len: 0 microversion: 2.1 time: 0.165674 Dec 15 16:14:00.078505 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 276/632] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:13:59 2021] DELETE /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments/158a1ef6-04bf-4cc1-beae-622918c458d7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:14:00.087630 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:00.088618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:00.094616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.095088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.095929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.096364 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.106302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:00.114197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-428b31f7-4c2b-4ee4-9fc6-e5db65359d36 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.168214 Dec 15 16:14:00.114770 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 357/633] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:13:59 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:00.126226 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4d95c607-ac3d-43c7-8c9a-7f4fcd732417 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Dec 15 16:14:00.126818 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 277/634] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:00 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:00.257097 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:00.257675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:00.263349 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.263795 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.264593 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.265027 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.402512 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:00.410529 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a14472dc-2187-40b6-839d-38d00ef056a5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.157781 Dec 15 16:14:00.411121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 358/635] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:00 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:00.589918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:00.590815 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:00.596977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.597447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.598218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.598643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.859643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-98044057-a1de-4dd4-91af-f61622be4847 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 32602 microversion: 2.1 time: 0.273149 Dec 15 16:14:00.860419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 278/636] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:00 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 32602 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:00.924118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:00.924719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:00.931072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.931519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:00.932297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:00.932754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.060986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:01.069655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:01.071181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:01.072330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d5a85c1-c447-4ea8-8ffa-7b221d1d4064 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.151907 Dec 15 16:14:01.072883 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 359/637] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:00 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:01.132450 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:01.132970 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:01.138163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:01.139149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:01.139766 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.140206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.140987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.141435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.144893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.145341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.146158 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.146593 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.175198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ddf8a731-7d2c-4ba5-8060-ffa16ff2594c tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040637 Dec 15 16:14:01.175772 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 360/638] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:01 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:01.289345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:01.297175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-86a2fa2f-feb5-4b4d-bcb8-84033c7036f5 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.169485 Dec 15 16:14:01.297773 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 279/639] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:01 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:01.427792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:01.428903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:01.434933 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.435383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.436163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.436597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.572858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:01.580614 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3660dbbe-514a-4c0b-86a6-00b97dea996b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.156598 Dec 15 16:14:01.581181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 361/640] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:01 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:01.871962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:01.872980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:01.879217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.879658 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:01.880432 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:01.880859 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.003499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8b098714-0442-4600-b81c-5ed3b3388bdf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 33059 microversion: 2.1 time: 0.135005 Dec 15 16:14:02.004796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 280/641] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:01 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 33059 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:02.089975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:02.090799 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:02.097295 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.097795 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.098822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.099359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.187762 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:02.188830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:02.196404 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.196847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.197851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.198278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.230920 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1fb7ded6-206b-4d83-8c38-bb595675f179 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047162 Dec 15 16:14:02.231783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 281/642] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:02 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:14:02.238772 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:02.248375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:02.250206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:02.251642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-262a6f97-8139-4021-b7a2-92a3959a50fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1806 microversion: 2.20 time: 0.165196 Dec 15 16:14:02.252335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 362/643] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:02 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:02.315166 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:02.315866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:02.322532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.323049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.324109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.324836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.485142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:02.494305 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-14b2b012-44ac-4b47-90cb-d1160934d17f tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.182796 Dec 15 16:14:02.494873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 282/644] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:02 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:02.598358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:02.598889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:02.604764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.605861 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.606728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:02.607170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:02.740391 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:02.750355 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ce78083f-761e-47e9-abda-e62da51e6a4f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.156154 Dec 15 16:14:02.751080 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 363/645] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:02 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:03.016273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:03.017100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:03.023460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.023905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.024683 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.025116 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.147433 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-98bc3bb2-77b1-4f86-a0ad-753113711a57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 33595 microversion: 2.1 time: 0.134582 Dec 15 16:14:03.148084 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 283/646] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:03 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 33595 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:03.270087 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.270643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:03.277030 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.277506 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.278283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.278717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.409499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:03.418508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:03.419980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:03.421125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-651cf313-381b-42e5-bfd0-222fd7ad57f2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1793 microversion: 2.20 time: 0.154824 Dec 15 16:14:03.421703 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 364/647] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:03 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1793 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:03.424699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.425280 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:03.432146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.432596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.433364 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.433819 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.457627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:03.511363 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.512053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:03.517885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.518328 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.519108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.519533 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.538620 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b91612e3-b2f3-4578-86f3-0b27774c3bc5 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 204 len: 0 microversion: 2.1 time: 0.116951 Dec 15 16:14:03.539265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 284/648] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:03 2021] DELETE /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:03.547437 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.548130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:03.553893 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.554327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.555103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.555530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.667413 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:03.675346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-05a828e2-debf-4508-8bbb-0a6cc1b424b8 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.167454 Dec 15 16:14:03.675920 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 365/649] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:03 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:03.689682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:03.697582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3fa43577-4a0c-47d9-b92d-d255b574b0f2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1513 microversion: 2.1 time: 0.153963 Dec 15 16:14:03.698153 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 285/650] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:03 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:03.767900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.768499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:03.774655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.775094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.775922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:03.776352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:03.905363 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:03.914049 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ff3372bf-da19-4581-b3bf-2fb77356e70b tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.149778 Dec 15 16:14:03.914624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 366/651] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:03 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:04.159341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:04.160209 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:04.167127 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.167566 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.168334 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.168759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.291684 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-08b85a4d-11d5-418e-9d37-5364e9cea54b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 34044 microversion: 2.1 time: 0.136103 Dec 15 16:14:04.292319 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 286/652] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:04 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 34044 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:04.692823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:04.693433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:04.700325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.700764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.701559 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.701991 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.715012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:04.715698 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:04.722426 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.722867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.723640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.724075 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.844964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:04.852806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b259516f-742c-4ea9-becf-0ceb289802c1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.163565 Dec 15 16:14:04.853596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 367/653] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:04 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:04.864819 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:04.872624 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-47f71d96-dd6b-45d3-bab5-ade70ec40ea2 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1513 microversion: 2.1 time: 0.161600 Dec 15 16:14:04.873181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 287/654] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:04 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:04.931048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:04.931652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:04.937459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.937900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:04.938665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:04.939092 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:05.065579 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:05.074152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2cda5dc9-53bd-419e-94fe-610f0c6cf571 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.147224 Dec 15 16:14:05.074755 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 368/655] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:04 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:05.304050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:05.304829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:05.311029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:05.311473 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:05.312244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:05.312676 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:05.439462 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6020ea8a-9750-47e8-b0cb-71f8d3d9f1cb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 34214 microversion: 2.1 time: 0.139680 Dec 15 16:14:05.440078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 288/656] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:05 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 34214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:05.869892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:05.870494 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:05.876608 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:05.877054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:05.877848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:05.878278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:05.889741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:05.890438 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:05.897670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:05.898118 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:05.898896 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:05.899322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.025112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:06.032894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3cbf9275-4dfd-4401-b984-d0455ac842bf tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.166660 Dec 15 16:14:06.033973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 369/657] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:05 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:06.036563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:06.044251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-43bdcd68-683a-4bd9-9d63-fa3d1af52b02 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1513 microversion: 2.1 time: 0.158497 Dec 15 16:14:06.044823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 289/658] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:05 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:06.091444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:06.092041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:06.097782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:06.098225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.098990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:06.099413 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.226314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:06.233984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e3cf33b5-9fb1-477e-86d9-2aee67addf83 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1568 microversion: 2.1 time: 0.146173 Dec 15 16:14:06.234553 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 370/659] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:06 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:06.451146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:06.451990 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:06.458164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:06.458612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.459419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:06.460011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.564796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cfbe197f-c527-4378-951c-8d25b7b39287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 34433 microversion: 2.1 time: 0.117126 Dec 15 16:14:06.565453 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 290/660] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:06 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 34433 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:07.050406 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.051077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.060007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.060467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.061281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.061753 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.062374 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.063459 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.071729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.072460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.073326 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.074561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.224344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:07.232125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e04ebef1-455f-4588-bfde-b4809f04fd15 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.185477 Dec 15 16:14:07.232704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 371/661] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:07 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:07.251024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.251631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.257923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.258369 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.259146 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.259580 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.317283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:07.325399 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8e37bc4-3918-4b24-b5c9-3aaa65064e90 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 200 len: 1513 microversion: 2.1 time: 0.267569 Dec 15 16:14:07.326070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 291/662] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:07 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:07.389771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:07.398812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-07683555-9e09-4053-9545-69eb1a6afa01 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1548 microversion: 2.1 time: 0.151299 Dec 15 16:14:07.399400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 372/663] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:07 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:07.416055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.416731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.424014 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.424525 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.425472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.426053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.495009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-a495b1d1-4b90-4fbc-b4b6-82516b20df9e req-263e5cfe-c132-44df-9fea-dcae7cdd4cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e519bc0-2a60-4c36-944b-0ee53a0f84fa", "name": "network-vif-deleted", "tag": "97f94f22-81f2-4990-ae11-e57a8f1e6d91"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:07.496895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:07.496895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:14:07.503556 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a495b1d1-4b90-4fbc-b4b6-82516b20df9e req-263e5cfe-c132-44df-9fea-dcae7cdd4cd8 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.503999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a495b1d1-4b90-4fbc-b4b6-82516b20df9e req-263e5cfe-c132-44df-9fea-dcae7cdd4cd8 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.516101 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-a495b1d1-4b90-4fbc-b4b6-82516b20df9e req-263e5cfe-c132-44df-9fea-dcae7cdd4cd8 service nova] Creating event network-vif-deleted:97f94f22-81f2-4990-ae11-e57a8f1e6d91 for instance 6e519bc0-2a60-4c36-944b-0ee53a0f84fa on hv-cinder-80070 Dec 15 16:14:07.521923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-a495b1d1-4b90-4fbc-b4b6-82516b20df9e req-263e5cfe-c132-44df-9fea-dcae7cdd4cd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030322 Dec 15 16:14:07.527193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 373/664] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:07.538319 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f52daeb-72c4-4375-a19f-7bad854fba4d while it is in vm_state rescued Dec 15 16:14:07.538927 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Returning 409 to user: Cannot 'detach_volume' instance 4f52daeb-72c4-4375-a19f-7bad854fba4d while it is in vm_state rescued {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:07.540297 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a3b108ef-1dd9-4982-8667-1983faad0aed tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments/ce87978f-53bd-444a-a036-0f73ed651345" status: 409 len: 152 microversion: 2.1 time: 0.128681 Dec 15 16:14:07.541450 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 292/665] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:14:07 2021] DELETE /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments/ce87978f-53bd-444a-a036-0f73ed651345 => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:14:07.549809 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:07.556052 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.563158 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.563620 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.564413 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.564913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.576238 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:07.577491 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.588694 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.589227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.590844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.591396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.640586 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bb1885db-eb3b-45b2-ad08-545087d7ba21 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action" status: 202 len: 0 microversion: 2.1 time: 0.094703 Dec 15 16:14:07.641938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 374/666] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:07 2021] POST /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:14:07.653065 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.655434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.662377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.663842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.664650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.665087 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.685446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d4a62836-09b4-4fa1-80e2-d217e8ada1d5 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 34927 microversion: 2.1 time: 0.112837 Dec 15 16:14:07.686179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 293/667] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:07 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 34927 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:07.803175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:07.811439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5a48dff4-82b6-486f-b755-1976c1dcedb2 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1556 microversion: 2.1 time: 0.165500 Dec 15 16:14:07.812029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 375/668] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:07 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:08.250265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:08.250932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:08.257708 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.258151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.259018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.259444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.341870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:08.343098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 6e519bc0-2a60-4c36-944b-0ee53a0f84fa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:08.348936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.349402 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.350869 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.351469 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.364759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] HTTP exception thrown: Instance 6e519bc0-2a60-4c36-944b-0ee53a0f84fa could not be found. Dec 15 16:14:08.365357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Returning 404 to user: Instance 6e519bc0-2a60-4c36-944b-0ee53a0f84fa could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:08.366821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bc33be20-74c4-4235-bf3c-53177e3ea66b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa" status: 404 len: 111 microversion: 2.1 time: 0.028514 Dec 15 16:14:08.367728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 376/669] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:08 2021] GET /compute/v2.1/servers/6e519bc0-2a60-4c36-944b-0ee53a0f84fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:14:08.412086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:08.420725 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-21b4e52b-3beb-4846-8cc0-4eca24ce44a2 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.174484 Dec 15 16:14:08.421457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 294/670] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:08 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:08.698888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:08.699791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:08.705960 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.706412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.707193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.707630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.798872 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-396375ff-39ce-47d4-a140-53b9b21d4dba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 35606 microversion: 2.1 time: 0.104841 Dec 15 16:14:08.801450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 377/671] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:08 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 35606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:08.828960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:08.829599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:08.836114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.836560 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.837335 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.837797 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.970080 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:08.978464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c9a9dee7-b430-4da4-8a44-11c8553fafc5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1556 microversion: 2.1 time: 0.153171 Dec 15 16:14:08.979040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 295/672] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:08 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:09.439043 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.439730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:09.446658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.447103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.447876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.448308 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.492533 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.493039 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:09.499285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.499735 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.500523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.500961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.529040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:09.599482 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:09.605884 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-71cd103d-a260-472c-8b0d-221bb1e17dcd tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 204 len: 0 microversion: 2.1 time: 0.116513 Dec 15 16:14:09.610068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 296/673] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:09 2021] DELETE /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:14:09.610959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb3df330-f58f-4bf1-b8ae-69b0264310fa tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1756 microversion: 2.1 time: 0.175883 Dec 15 16:14:09.620782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 378/674] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:09 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:09.620970 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.620970 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:09.621771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.622221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.622999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.623436 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.757430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:09.764709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-99c166df-d47b-4c43-a43b-ae9a6674dc7e tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1512 microversion: 2.1 time: 0.153537 Dec 15 16:14:09.765276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 297/675] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:09 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:09.811406 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:09.812315 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:09.818436 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.819429 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.820466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.820893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.907844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1db80680-2f9c-42c8-a0ed-fa477d9140a0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 36352 microversion: 2.1 time: 0.100435 Dec 15 16:14:09.908493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 379/676] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:09 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 36352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:09.996253 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.996781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:10.002547 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.002985 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.003741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.004164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.133128 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:10.140763 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5b3c2b54-79c2-413e-8a25-501129ff9796 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1556 microversion: 2.1 time: 0.148341 Dec 15 16:14:10.141318 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 298/677] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:09 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:10.628492 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:10.629205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:10.636742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.637187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.637998 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.638430 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.779546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:10.782266 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:10.782869 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:10.787634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-94e60ef9-0bd6-48e8-b11e-91d1ebfbb343 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1759 microversion: 2.1 time: 0.163158 Dec 15 16:14:10.788356 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 380/678] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:10 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:10.788754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.789271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.790077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.790508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.918890 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:10.920475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:10.921665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:10.927408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-def54864-2ac4-4440-a08b-4dfb8d50c060 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1512 microversion: 2.1 time: 0.148635 Dec 15 16:14:10.928128 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 299/679] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:10 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:10.928794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.929203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.930193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.930627 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.039136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f98585ef-a3fb-401e-8a2d-ad66dbd3e713 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 36957 microversion: 2.1 time: 0.122786 Dec 15 16:14:11.040075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 381/680] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:10 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 36957 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:11.158395 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:11.159257 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:11.166217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.166582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.167344 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.167782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.297178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:11.305185 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c08b712-772d-4914-95d6-32b59eeddfc9 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1562 microversion: 2.1 time: 0.150387 Dec 15 16:14:11.305789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 300/681] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:11 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:11.369643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:11.370220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:11.376946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.377414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.378188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.378618 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.458061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lazy-loading 'services' on Instance uuid 4f52daeb-72c4-4375-a19f-7bad854fba4d {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:11.524534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef7cedc4-66ea-4bca-ad7e-e4614faf9f4a tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments/ce87978f-53bd-444a-a036-0f73ed651345" status: 202 len: 0 microversion: 2.1 time: 0.158915 Dec 15 16:14:11.525118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 382/682] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:14:11 2021] DELETE /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments/ce87978f-53bd-444a-a036-0f73ed651345 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:11.541201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:11.542349 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:11.548711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.549201 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.550169 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.550624 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.583921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1609574d-6f7e-4960-87de-2c356c1272dd tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054313 Dec 15 16:14:11.585216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 301/683] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:11 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:11.946724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:11.947416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:11.953546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.953987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.954760 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.955183 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.050792 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:12.056663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:12.062472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.062918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.063699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.064131 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.086997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:12.094435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f295c4cb-03af-408e-99ac-ec6a6258c3d7 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1512 microversion: 2.1 time: 0.152843 Dec 15 16:14:12.095001 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 383/684] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:11 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:12.147790 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-02fdeb8d-afa0-42ab-8193-178877783869 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 37778 microversion: 2.1 time: 0.100109 Dec 15 16:14:12.148460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 302/685] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:12 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 37778 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:12.568558 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-056e6b3d-a080-4894-a513-871842e9b776 req-9f0bc8ae-bf4b-4405-89d8-abe1440804ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b857430f-d0fd-4457-b7e6-10a1052f95bc", "name": "network-vif-deleted", "tag": "bb6a09e3-ff84-472c-af29-bc280464c380"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:12.570811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:12.570811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:14:12.578298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-056e6b3d-a080-4894-a513-871842e9b776 req-9f0bc8ae-bf4b-4405-89d8-abe1440804ce service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.578748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-056e6b3d-a080-4894-a513-871842e9b776 req-9f0bc8ae-bf4b-4405-89d8-abe1440804ce service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.589859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-056e6b3d-a080-4894-a513-871842e9b776 req-9f0bc8ae-bf4b-4405-89d8-abe1440804ce service nova] Creating event network-vif-deleted:bb6a09e3-ff84-472c-af29-bc280464c380 for instance b857430f-d0fd-4457-b7e6-10a1052f95bc on hv-cinder-80070 Dec 15 16:14:12.596112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-056e6b3d-a080-4894-a513-871842e9b776 req-9f0bc8ae-bf4b-4405-89d8-abe1440804ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 Dec 15 16:14:12.599854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 384/686] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:12.601668 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:12.602612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:12.611684 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.612369 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.613368 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.614018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.657211 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5ea7d388-9b18-4319-b38a-47f9f1ab5ee5 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064272 Dec 15 16:14:12.657821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 303/687] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:12 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:14:13.112835 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:13.114462 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:13.121192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.121671 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.122454 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.122887 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.154556 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.155073 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.155538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lazy-loading 'fault' on Instance uuid b857430f-d0fd-4457-b7e6-10a1052f95bc {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:13.160622 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:13.161561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:13.169181 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.169913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.170845 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.171428 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.204865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:13.212453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6d697a6-2a59-4e33-b5d0-7baa3a0ebb4a tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 200 len: 1306 microversion: 2.1 time: 0.104543 Dec 15 16:14:13.213028 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 385/688] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:13 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:13.268431 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ebb60c98-b4aa-4b19-b31c-8f8b8b5c28ab tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 38132 microversion: 2.1 time: 0.111580 Dec 15 16:14:13.269329 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 304/689] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:13 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 38132 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:14.229637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:14.230287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: b857430f-d0fd-4457-b7e6-10a1052f95bc] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:14.236488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.236930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.237724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.238173 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.251869 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] HTTP exception thrown: Instance b857430f-d0fd-4457-b7e6-10a1052f95bc could not be found. Dec 15 16:14:14.252463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Returning 404 to user: Instance b857430f-d0fd-4457-b7e6-10a1052f95bc could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:14.253450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-519d7a1c-021c-47b5-9d59-92dd3516bf05 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc" status: 404 len: 111 microversion: 2.1 time: 0.027989 Dec 15 16:14:14.254389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 386/690] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:14 2021] GET /compute/v2.1/servers/b857430f-d0fd-4457-b7e6-10a1052f95bc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:14.262569 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:14.263161 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:14.269902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.270342 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.271106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.271530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.279728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:14.280643 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:14.286786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.287227 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.288594 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.289180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.297659 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:14.355866 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9c3010a5-1473-47ee-9598-62786fb3e1c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 38132 microversion: 2.1 time: 0.079509 Dec 15 16:14:14.356750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 387/691] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:14 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 38132 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:14.369376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c3d0266f-8421-4a43-b666-588db99e8259 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 204 len: 0 microversion: 2.1 time: 0.110610 Dec 15 16:14:14.370054 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 305/692] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:14 2021] DELETE /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:14.378414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:14.379106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:14.386500 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.386948 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.387720 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.388150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.519272 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:14.526639 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3f0dad41-45ce-414a-a228-39e7b6c8144f tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1514 microversion: 2.1 time: 0.152285 Dec 15 16:14:14.527193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 388/693] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:14 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:14.979751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:14.980726 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:14.987842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.988287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:14.989056 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:14.989526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.016050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:15.109536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-21fff745-0dcf-41ab-879a-b1d67c74649c tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 204 len: 0 microversion: 2.1 time: 0.133756 Dec 15 16:14:15.110141 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 306/694] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:14 2021] DELETE /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:14:15.124473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:15.124473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:15.127555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:15.128005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.128934 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:15.129365 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.274897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:15.282375 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-88ada986-889e-49d8-bda1-d6c88ab38c44 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1508 microversion: 2.1 time: 0.166372 Dec 15 16:14:15.282942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 389/695] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:15 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:15.369592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:15.370598 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:15.376896 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:15.377338 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.378150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:15.378584 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.467235 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6722bf2a-a468-4b38-94fe-e425cab8756f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 38143 microversion: 2.1 time: 0.102499 Dec 15 16:14:15.468103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 307/696] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:15 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 38143 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:15.545263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:15.546050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:15.552874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:15.554038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.554967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:15.555399 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:15.689734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:15.698063 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-772865c9-6307-43ee-8afa-96e61b6be035 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1514 microversion: 2.1 time: 0.157214 Dec 15 16:14:15.698634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 390/697] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:15 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:16.303968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:16.304679 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:16.311479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.311954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.312722 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.313157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.480177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:16.481292 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:16.486939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.487388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.488169 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.488621 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.523377 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:16.530626 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f5b9384f-f0d1-4f61-97fc-6acf9660eccb tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1508 microversion: 2.1 time: 0.231201 Dec 15 16:14:16.531399 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 308/698] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:16 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:16.565004 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4010be98-d397-41ba-8308-3459b00f4c92 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 200 len: 38263 microversion: 2.1 time: 0.089290 Dec 15 16:14:16.565600 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 391/699] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:16 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 38263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:16.575354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:16.575926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:16.582610 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.583065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.583836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.584288 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.607715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f45f6618-28ce-42aa-b8a3-4127235882bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/ips" status: 200 len: 145 microversion: 2.1 time: 0.035838 Dec 15 16:14:16.621624 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 309/700] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 16:14:16 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:16.702220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-b82c9a2c-6de5-4ae5-83e5-2708229a0bf7 req-d385bc30-1a12-4a95-9a34-43a7b661bb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522fff52-5215-429c-badc-a248701121d4", "name": "network-vif-deleted", "tag": "8839979d-1332-42c7-8845-4f562f79a7ba"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:16.704885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:16.704885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:14:16.716955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:16.717611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:16.723921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.724404 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.725272 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.726517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.734888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b82c9a2c-6de5-4ae5-83e5-2708229a0bf7 req-d385bc30-1a12-4a95-9a34-43a7b661bb62 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.735323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b82c9a2c-6de5-4ae5-83e5-2708229a0bf7 req-d385bc30-1a12-4a95-9a34-43a7b661bb62 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.751497 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-b82c9a2c-6de5-4ae5-83e5-2708229a0bf7 req-d385bc30-1a12-4a95-9a34-43a7b661bb62 service nova] Creating event network-vif-deleted:8839979d-1332-42c7-8845-4f562f79a7ba for instance 522fff52-5215-429c-badc-a248701121d4 on hv-cinder-80070 Dec 15 16:14:16.757581 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-b82c9a2c-6de5-4ae5-83e5-2708229a0bf7 req-d385bc30-1a12-4a95-9a34-43a7b661bb62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058762 Dec 15 16:14:16.758339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 392/701] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:16.796708 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:16.804313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2c1809de-fceb-4164-9889-dd0ea65726fe tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 200 len: 1303 microversion: 2.1 time: 0.091135 Dec 15 16:14:16.804909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 310/702] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:16 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:17.547617 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:17.548316 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:17.555759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.556204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.556964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.557405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.688050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:17.695754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-275791c8-4129-411e-9e93-74ea18c329c0 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1508 microversion: 2.1 time: 0.152185 Dec 15 16:14:17.696314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 393/703] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:17 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:17.821065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:17.821729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: 522fff52-5215-429c-badc-a248701121d4] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:17.828161 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.828606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.829413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.829854 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.843652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] HTTP exception thrown: Instance 522fff52-5215-429c-badc-a248701121d4 could not be found. Dec 15 16:14:17.844246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Returning 404 to user: Instance 522fff52-5215-429c-badc-a248701121d4 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:17.845074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ffe7fabe-e95d-4d53-9087-d87cba68f437 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4" status: 404 len: 111 microversion: 2.1 time: 0.027719 Dec 15 16:14:17.845645 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 311/704] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:17 2021] GET /compute/v2.1/servers/522fff52-5215-429c-badc-a248701121d4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:18.712298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:18.712854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:18.719062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:18.719512 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:18.720260 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:18.720684 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:18.751634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:18.752078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:18.752515 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lazy-loading 'fault' on Instance uuid f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:18.776504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-c6c2ba67-7b10-4073-9f92-6e2712a253bc req-53f557a2-d648-4ddc-8471-759b941a8244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50", "name": "network-vif-deleted", "tag": "fdd65e26-501b-4251-b404-78bc05ad4f44"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:18.778097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:18.778097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:14:18.785349 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c6c2ba67-7b10-4073-9f92-6e2712a253bc req-53f557a2-d648-4ddc-8471-759b941a8244 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:18.785817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c6c2ba67-7b10-4073-9f92-6e2712a253bc req-53f557a2-d648-4ddc-8471-759b941a8244 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:18.793091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:18.797249 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-c6c2ba67-7b10-4073-9f92-6e2712a253bc req-53f557a2-d648-4ddc-8471-759b941a8244 service nova] Creating event network-vif-deleted:fdd65e26-501b-4251-b404-78bc05ad4f44 for instance f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 on hv-cinder-80070 Dec 15 16:14:18.801453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34bdf5a2-8834-4ad8-8556-dcf85561e36e tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 200 len: 1312 microversion: 2.1 time: 0.092843 Dec 15 16:14:18.801885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-c6c2ba67-7b10-4073-9f92-6e2712a253bc req-53f557a2-d648-4ddc-8471-759b941a8244 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029075 Dec 15 16:14:18.808434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 394/705] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:18 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:18.809041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 312/706] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:18.974667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:18.975666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:18.981831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:18.982276 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:18.983041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:18.983470 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.009114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:19.088828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e93d021c-9469-4284-9369-835210ff2531 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 204 len: 0 microversion: 2.1 time: 0.117383 Dec 15 16:14:19.089710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 395/707] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:18 2021] DELETE /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:19.098397 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:19.099092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:19.106316 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.106770 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.107561 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.107999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.250717 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:19.258459 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f84f8a82-bca9-454e-a443-3b4d41369d92 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1513 microversion: 2.1 time: 0.164092 Dec 15 16:14:19.259034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 313/708] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:19 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:19.268422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efd17f8a-fad3-44a0-b98e-a49820ebf20f"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:19.269597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:19.276164 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.276610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.277416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.277840 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.517736 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-886f1040-3612-4770-a95c-d7e57ae80b91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253105 Dec 15 16:14:19.518478 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 396/709] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:14:19 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:19.818777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:19.819894 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:19.826016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.826455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.827217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.827640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.840760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] HTTP exception thrown: Instance f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 could not be found. Dec 15 16:14:19.841323 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Returning 404 to user: Instance f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:19.842141 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-aaefb696-903b-4dc7-be8d-cd3f4b9e597f tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50" status: 404 len: 111 microversion: 2.1 time: 0.026973 Dec 15 16:14:19.842643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 314/710] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:19 2021] GET /compute/v2.1/servers/f4a4a6eb-619f-4002-b7d1-cf71d5bcdf50 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:19.850830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:19.851405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:19.857772 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.858211 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.858982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.859410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.886363 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:19.958607 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-17cf5d96-d599-452c-a6c3-2aa78c98cb86 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 204 len: 0 microversion: 2.1 time: 0.111347 Dec 15 16:14:19.959153 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 397/711] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:19 2021] DELETE /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:19.968088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:19.968819 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:19.974962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.975416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:19.976188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:19.976683 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:20.107269 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:20.114486 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-935cd236-44f1-4983-8695-dc896f2eb92d tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.150987 Dec 15 16:14:20.115033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 315/712] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:19 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:20.275013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:20.275692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:20.281772 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:20.282210 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:20.282969 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:20.283394 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:20.412005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:20.419695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3b4074c9-a784-4c8d-9b9a-5b893d7e66ef tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1513 microversion: 2.1 time: 0.148754 Dec 15 16:14:20.420263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 398/713] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:20 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:21.131726 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:21.132329 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:21.139351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.139804 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.140584 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.141016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.312196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:21.319830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-27a91a20-1bb7-4d0b-ab7d-c8de2f1da2a4 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.191691 Dec 15 16:14:21.320401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 316/714] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:21 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:21.436155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:21.436846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:21.443345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.443840 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.444628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.445051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.587215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df09b0b78f6646ed8c520c5c46b3eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59432b92e45948e5962f7a60e09135b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:21.594790 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98dd4ea5-4fe4-4d24-9b0b-0b06e5c1eb11 tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 200 len: 1513 microversion: 2.1 time: 0.162247 Dec 15 16:14:21.595453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 399/715] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:21 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:21.721344 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-b3407591-82b6-4bef-b1df-46a715198b52 req-a5d4c17c-41cc-4b00-80ba-f6ce2c6e6ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd5f486-3302-4f15-ba29-0a1734919fcb", "name": "network-vif-deleted", "tag": "648d6170-f09f-415c-8e88-60e67684a8da"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:21.723240 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:21.723240 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:14:21.732581 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-b3407591-82b6-4bef-b1df-46a715198b52 req-a5d4c17c-41cc-4b00-80ba-f6ce2c6e6ff2 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.733031 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-b3407591-82b6-4bef-b1df-46a715198b52 req-a5d4c17c-41cc-4b00-80ba-f6ce2c6e6ff2 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.746364 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-b3407591-82b6-4bef-b1df-46a715198b52 req-a5d4c17c-41cc-4b00-80ba-f6ce2c6e6ff2 service nova] Creating event network-vif-deleted:648d6170-f09f-415c-8e88-60e67684a8da for instance cdd5f486-3302-4f15-ba29-0a1734919fcb on hv-cinder-80070 Dec 15 16:14:21.752782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-b3407591-82b6-4bef-b1df-46a715198b52 req-a5d4c17c-41cc-4b00-80ba-f6ce2c6e6ff2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035067 Dec 15 16:14:21.753821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 317/716] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:22.336407 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:22.337022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:22.343293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:22.343725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:22.344577 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:22.345100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:22.474422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:22.481837 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8bc0ddad-2e08-4d7e-bcc2-091b00235172 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.149831 Dec 15 16:14:22.482414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 400/717] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:22 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:22.612924 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:22.613557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] [instance: cdd5f486-3302-4f15-ba29-0a1734919fcb] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:22.620103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:22.620584 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:22.621357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:22.621817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:22.634776 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] HTTP exception thrown: Instance cdd5f486-3302-4f15-ba29-0a1734919fcb could not be found. Dec 15 16:14:22.635357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] Returning 404 to user: Instance cdd5f486-3302-4f15-ba29-0a1734919fcb could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:22.636168 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c90c8ee6-2483-4223-bf55-a71c2c6eee2b tempest-AttachVolumeNegativeTest-14724789 tempest-AttachVolumeNegativeTest-14724789-project] 10.222.0.36 "GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb" status: 404 len: 111 microversion: 2.1 time: 0.027375 Dec 15 16:14:22.636716 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 318/718] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:22 2021] GET /compute/v2.1/servers/cdd5f486-3302-4f15-ba29-0a1734919fcb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:23.499249 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:23.499723 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:23.506044 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:23.507044 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:23.508000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:23.508431 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:23.640385 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:23.648522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2b3bdd9c-973f-4e75-8c51-30f10c55fa39 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.152912 Dec 15 16:14:23.649098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 401/719] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:23 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:24.666314 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:24.667016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:24.673207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:24.673681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:24.674449 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:24.674874 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:24.814750 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:24.827549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-84f54d51-aa6a-482d-83f0-c5d14f5bbf29 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.161526 Dec 15 16:14:24.827549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 319/720] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:24 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:25.840280 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:25.840889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:25.846922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:25.847599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:25.849410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:25.849860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:25.988000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:25.995851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4c87736-9f7a-4524-9f9c-da1acebb1528 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1522 microversion: 2.1 time: 0.159217 Dec 15 16:14:25.996646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 402/721] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:25 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:27.013837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:27.014488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:27.021266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bfb83ed7-a9cc-4e93-931d-bb2b5b57df90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:27.040837 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfb83ed7-a9cc-4e93-931d-bb2b5b57df90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:27.042588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:27.043151 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfb83ed7-a9cc-4e93-931d-bb2b5b57df90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:27.046297 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:27.047357 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:27.047764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:27.120794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bfb83ed7-a9cc-4e93-931d-bb2b5b57df90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Going to try to stop instance {{(pid=116084) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:14:27.138349 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7af97c50dab46dd85477944b2450a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1847fe78e7459f800877907c42878d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:27.145968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1d0edb65-68a3-4850-be74-7b72da713299 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 200 len: 1306 microversion: 2.1 time: 0.135807 Dec 15 16:14:27.147349 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 320/722] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:27 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 1306 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:27.152095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-f5f555b1-84d6-4e0d-8b66-2f4e4bfee53f req-3c0770e4-b8e1-47a9-8845-085ffdda847a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f52daeb-72c4-4375-a19f-7bad854fba4d", "name": "network-vif-deleted", "tag": "dcc16873-43c3-4ab9-a1c5-a436ca059a16"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:27.153910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:27.153910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:14:27.163508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f5f555b1-84d6-4e0d-8b66-2f4e4bfee53f req-3c0770e4-b8e1-47a9-8845-085ffdda847a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:27.164025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f5f555b1-84d6-4e0d-8b66-2f4e4bfee53f req-3c0770e4-b8e1-47a9-8845-085ffdda847a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:27.176101 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-f5f555b1-84d6-4e0d-8b66-2f4e4bfee53f req-3c0770e4-b8e1-47a9-8845-085ffdda847a service nova] Creating event network-vif-deleted:dcc16873-43c3-4ab9-a1c5-a436ca059a16 for instance 4f52daeb-72c4-4375-a19f-7bad854fba4d on hv-cinder-80070 Dec 15 16:14:27.182494 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-f5f555b1-84d6-4e0d-8b66-2f4e4bfee53f req-3c0770e4-b8e1-47a9-8845-085ffdda847a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Dec 15 16:14:27.183088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 321/723] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:27.189283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bfb83ed7-a9cc-4e93-931d-bb2b5b57df90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 202 len: 0 microversion: 2.1 time: 0.171375 Dec 15 16:14:27.190233 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 403/724] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:27 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:14:27.206012 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:27.207179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:27.215398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:27.215880 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:27.216664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:27.217094 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:27.352209 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:27.359934 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-aa7dc203-c423-46e2-b7e1-858faa17c64a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.165012 Dec 15 16:14:27.360501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 322/725] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:27 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:28.164538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:28.165145 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] [instance: 4f52daeb-72c4-4375-a19f-7bad854fba4d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:28.171113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:28.171653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:28.172365 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:28.172803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:28.186031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] HTTP exception thrown: Instance 4f52daeb-72c4-4375-a19f-7bad854fba4d could not be found. Dec 15 16:14:28.186611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] Returning 404 to user: Instance 4f52daeb-72c4-4375-a19f-7bad854fba4d could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:28.187418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d9fe1591-65d3-4cd9-a2e7-f50b7014d087 tempest-ServerRescueNegativeTestJSON-2074748937 tempest-ServerRescueNegativeTestJSON-2074748937-project] 10.222.0.36 "GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d" status: 404 len: 111 microversion: 2.1 time: 0.027748 Dec 15 16:14:28.187934 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 404/726] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:28 2021] GET /compute/v2.1/servers/4f52daeb-72c4-4375-a19f-7bad854fba4d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:28.378110 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:28.378720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:28.385798 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:28.386243 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:28.387039 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:28.387471 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:28.518914 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:28.526938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e39b7506-2fc0-48b2-a682-640c200f0286 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.152569 Dec 15 16:14:28.527509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 323/727] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:28 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:29.544056 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:29.544928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:29.551152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.551713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.552567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.553007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.816663 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:29.824351 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cf8bf03f-2251-46c4-9aa4-acce47be47a6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.284169 Dec 15 16:14:29.824913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 405/728] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:29 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:30.841718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:30.842471 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:30.849826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:30.850557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:30.851709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:30.852564 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:31.246806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:31.255182 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f1576565-b6a7-4c19-8a88-fd8be048b945 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.417101 Dec 15 16:14:31.255742 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 324/729] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:30 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:32.272446 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:32.273591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:32.280187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:32.280639 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:32.281475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:32.281877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:32.416629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:32.426800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-779cd13a-c5df-460b-8bfd-de512eb59f1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.155935 Dec 15 16:14:32.427400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 406/730] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:32 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:33.445828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:33.446501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:33.452376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:33.452899 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:33.453864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:33.454280 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:33.609627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:33.617713 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c4d3b8a8-73b0-411d-a54f-6fd4df7bb3ae tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.176687 Dec 15 16:14:33.618278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 325/731] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:33 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:34.639573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:34.640167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:34.646421 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:34.646863 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:34.647708 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:34.648137 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:34.791380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:34.800623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-77dc4c5e-168b-4c9d-ae1e-1b0de001b85d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.164344 Dec 15 16:14:34.801377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 407/732] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:34 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:35.818001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:35.818592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:35.825620 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:35.826071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:35.826846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:35.827302 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:35.968937 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:35.980356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5caa0eba-d068-4bc0-92b6-3eeb555561e4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.165314 Dec 15 16:14:35.981123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 326/733] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:35 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:37.009002 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:37.009782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:37.016243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:37.017053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:37.018350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:37.019005 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:37.161316 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:37.169377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-24f8d0aa-54c0-42a9-ad70-f3891b36115d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.164509 Dec 15 16:14:37.169980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 408/734] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:37 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:38.186401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:38.187041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:38.193208 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:38.193628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:38.194977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:38.195478 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:38.328412 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:38.336360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-dbf0b491-19ea-4146-be4d-e40c13afbd37 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.153533 Dec 15 16:14:38.336930 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 327/735] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:38 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:39.354130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:39.354730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:39.361468 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:39.361909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:39.362672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:39.363096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:39.493637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:39.501243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f0099f05-ea4d-4403-9420-2437b1d5667c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.150860 Dec 15 16:14:39.501834 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 409/736] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:39 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:40.518605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:40.519203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:40.525356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:40.525830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:40.526596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:40.527024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:40.656667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:40.665245 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-13f5076c-c5a3-4dd2-8cef-494f1119e06a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.150349 Dec 15 16:14:40.665834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 328/737] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:40 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:41.683328 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:41.683938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:41.690095 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:41.690539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:41.691312 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:41.691742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:41.829402 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:41.837120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c6510315-0987-40a8-9cde-bf37acff956b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.158525 Dec 15 16:14:41.837728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 410/738] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:41 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:42.854559 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:42.855175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:42.861528 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:42.861974 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:42.862757 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:42.863195 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:43.044354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:43.052446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d64069d8-a58d-4b29-b69c-92ba1e0aced7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.201982 Dec 15 16:14:43.053225 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 329/739] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:42 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:44.070744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:44.072344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:44.080434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:44.081298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:44.082393 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:44.083066 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:44.274528 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:44.283132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-652b97c2-a215-431c-b928-7ebe82b1d38c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.217383 Dec 15 16:14:44.283882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 411/740] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:44 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:45.301318 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:45.301929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:45.308207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:45.308653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:45.309451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:45.309884 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:45.467499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:45.475284 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-34273a45-880c-4473-96db-1d2bed83c21a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.177657 Dec 15 16:14:45.475906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 330/741] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:45 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:46.492889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:46.493539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:46.500031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:46.500476 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:46.501257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:46.501715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:46.657155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:46.667555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ec651a48-e8e7-4ea9-bde3-6cc676991563 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.179425 Dec 15 16:14:46.668146 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 412/742] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:46 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:47.687230 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:47.687230 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:47.693741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:47.695631 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:47.696803 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:47.697499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:47.872722 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:47.882096 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-62664577-871d-45f7-bb81-76a803cca7a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1723 microversion: 2.1 time: 0.200751 Dec 15 16:14:47.891761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 331/743] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:47 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:48.536659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:48.537184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:48.543477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.543930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.544704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.545141 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.574308 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-55f136d4-baed-4ff0-acab-797cea166927 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments/8bab1bc7-b42d-4d47-b984-596ab8dd67c0" status: 200 len: 194 microversion: 2.20 time: 0.041705 Dec 15 16:14:48.574914 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 413/744] 10.222.0.36 () {60 vars in 1453 bytes} [Wed Dec 15 16:14:48 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments/8bab1bc7-b42d-4d47-b984-596ab8dd67c0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:48.637078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:48.637608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:48.643934 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.644379 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.645152 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.645614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.728135 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lazy-loading 'services' on Instance uuid 58bcd354-b76f-4f2c-8062-f7888f226c7c {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:48.797004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4eeee942-190f-4a21-a158-b7b2b9848a9b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments/8bab1bc7-b42d-4d47-b984-596ab8dd67c0" status: 202 len: 0 microversion: 2.20 time: 0.163498 Dec 15 16:14:48.798050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 332/745] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Dec 15 16:14:48 2021] DELETE /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments/8bab1bc7-b42d-4d47-b984-596ab8dd67c0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:48.807223 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:48.808292 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:48.815528 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.816196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.817024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.817549 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.854181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7a4ac593-c6bb-40ae-8c07-fbe2aded6792 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051602 Dec 15 16:14:48.854735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 414/746] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 16:14:48 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:48.900569 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:48.901273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:48.908539 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.908999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:48.910327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:48.910773 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.078983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:49.090321 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-23ee51fd-8752-4f4d-80bd-6cc1caacca51 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1700 microversion: 2.1 time: 0.194165 Dec 15 16:14:49.091178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 333/747] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:48 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1700 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:49.107258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-33672103-22a1-4aab-a5fb-21545a83abcb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:49.113828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-33672103-22a1-4aab-a5fb-21545a83abcb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.114278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-33672103-22a1-4aab-a5fb-21545a83abcb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.137911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-33672103-22a1-4aab-a5fb-21545a83abcb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Going to try to start instance {{(pid=116084) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:14:49.183399 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-33672103-22a1-4aab-a5fb-21545a83abcb tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 202 len: 0 microversion: 2.1 time: 0.079894 Dec 15 16:14:49.189789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 415/748] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:49 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:49.197857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:49.198482 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:49.208044 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.208492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.210067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.213033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.441345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:49.451182 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-17839f6a-781a-4ebe-83b2-ffea4b654b1e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1709 microversion: 2.1 time: 0.257543 Dec 15 16:14:49.462058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 334/749] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:49 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1709 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:49.866752 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:49.868378 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:49.874774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.875397 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.876171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.876602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.909263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-354f34b4-7ba1-4648-bbd3-32df0b6d50b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047134 Dec 15 16:14:49.910224 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 416/750] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 16:14:49 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:49.973108 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:49.973623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:49.980073 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.980514 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:49.981278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:49.981778 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:50.006769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:50.089459 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b3f5564f-992a-4b19-ae5e-e27b2563d111 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 204 len: 0 microversion: 2.20 time: 0.119568 Dec 15 16:14:50.090974 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 335/751] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 16:14:49 2021] DELETE /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:14:50.101115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:50.101943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:50.107704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:50.108354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:50.109199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:50.109743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:50.244651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:50.253074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:50.254670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:50.256012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a42e127-1d37-4263-9e65-57ede26902b8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.160330 Dec 15 16:14:50.256623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 417/752] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:50 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:50.470215 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:50.471563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:50.478922 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:50.479403 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:50.480253 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:50.481110 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:50.645756 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:50.656798 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fc49e553-8115-4ca7-beca-87c9606eca91 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1709 microversion: 2.1 time: 0.190483 Dec 15 16:14:50.657693 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 336/753] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:50 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:51.276174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:51.276773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:51.282513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:51.282955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:51.283721 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:51.284148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:51.426462 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:51.435133 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:51.436645 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:51.437860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3fc0f6a4-4cc2-4e16-83bf-a34c3c0aee9d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.165981 Dec 15 16:14:51.438408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 418/754] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:51 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:14:51.674616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:51.675221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:51.681504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:51.681951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:51.682722 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:51.683151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:51.821599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:51.830962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d4878919-358d-42c0-a721-8c07be4a5ea3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1713 microversion: 2.1 time: 0.159885 Dec 15 16:14:51.831739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 337/755] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:51 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:52.457975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:52.458588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:52.465254 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:52.465833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:52.466712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:52.467212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:52.637446 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:52.646546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:52.648201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:52.649676 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-86836c1f-a06e-49b2-b16e-1c9552e5cad9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1721 microversion: 2.20 time: 0.197838 Dec 15 16:14:52.650693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 419/756] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:52 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:52.937750 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-718525851"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:52.941163 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:52.948523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:52.949031 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:52.949846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:52.950286 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:53.440785 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.network.security_group_api [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Removing security group f7344dae-f88c-442d-8a01-50bbb42f0b8f from port 282cd38c-1d07-4bb0-8400-a79f6db5a357 Dec 15 16:14:53.596274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-39250ca9-1480-41cd-9ec7-3dc78ada2210 req-b032edb3-8b1f-4c51-9f42-86245c3e9255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bcd354-b76f-4f2c-8062-f7888f226c7c", "name": "network-vif-deleted", "tag": "40d81db4-2a75-40a9-8da4-0d709f3e2559"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:53.598457 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:53.598457 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:14:53.617142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-39250ca9-1480-41cd-9ec7-3dc78ada2210 req-b032edb3-8b1f-4c51-9f42-86245c3e9255 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:53.617875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-39250ca9-1480-41cd-9ec7-3dc78ada2210 req-b032edb3-8b1f-4c51-9f42-86245c3e9255 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:53.632124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-39250ca9-1480-41cd-9ec7-3dc78ada2210 req-b032edb3-8b1f-4c51-9f42-86245c3e9255 service nova] Creating event network-vif-deleted:40d81db4-2a75-40a9-8da4-0d709f3e2559 for instance 58bcd354-b76f-4f2c-8062-f7888f226c7c on hv-cinder-80070 Dec 15 16:14:53.638428 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-39250ca9-1480-41cd-9ec7-3dc78ada2210 req-b032edb3-8b1f-4c51-9f42-86245c3e9255 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045100 Dec 15 16:14:53.639758 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 420/757] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:53.669074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:53.670341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:53.679078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:53.680052 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:53.681017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:53.681815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:53.725422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:53.726175 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:53.726821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lazy-loading 'fault' on Instance uuid 58bcd354-b76f-4f2c-8062-f7888f226c7c {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:53.776862 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:53.785325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:53.787348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:53.789815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a02326a-5afd-43ea-b975-5b9d6bdb1deb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 200 len: 1371 microversion: 2.20 time: 0.124737 Dec 15 16:14:53.791128 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 421/758] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:53 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:14:53.915937 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8dd373e0-86bf-4c0c-b479-84e9c45dd6c3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/action" status: 202 len: 0 microversion: 2.1 time: 0.987709 Dec 15 16:14:53.916919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 338/759] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:14:52 2021] POST /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/action => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:54.250366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1387838064", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "12a9bd9f-1183-4bb2-81d2-63d81ac64ccf"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:54.311288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] validate_networks() for [('12a9bd9f-1183-4bb2-81d2-63d81ac64ccf', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:14:54.764264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:14:54.765715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:14:54.766498 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:14:54.767432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:14:54.768060 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:14:54.782499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:54.783160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:54.785159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:54.785922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:54.808084 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.808694 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:54.810487 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Getting quotas for project 0ca560754a9c4530ba707aef9b98cff8. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:14:54.817739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:54.818186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:54.819530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:54.819796 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Getting quotas for user ffd7b536c17849f0b4b790e589c4cef0 and project 0ca560754a9c4530ba707aef9b98cff8. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:14:54.820022 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:54.832445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:14:54.835891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:14:54.855208 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] HTTP exception thrown: Instance 58bcd354-b76f-4f2c-8062-f7888f226c7c could not be found. Dec 15 16:14:54.856086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Returning 404 to user: Instance 58bcd354-b76f-4f2c-8062-f7888f226c7c could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:54.857130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bfa72435-560a-4325-9cc6-98c6e816c99c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 404 len: 111 microversion: 2.20 time: 0.052598 Dec 15 16:14:54.858250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 339/760] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:54 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:14:54.865742 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-27def781-6731-4243-86f5-fc63a9847ce0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '.version_select at 0x7f88b81dc040>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.915916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-27def781-6731-4243-86f5-fc63a9847ce0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600518795" status: 204 len: 0 microversion: 2.20 time: 0.053450 Dec 15 16:14:54.916499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 340/761] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Dec 15 16:14:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600518795 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 16:14:54.928031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [b78b62d1-03b5-4e5a-94bc-dbcb0673ec0f] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 16:14:55.547060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:55.547556 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:55.556544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:55.556996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:55.557828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:55.558452 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:55.676779 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lazy-loading 'services' on Instance uuid 200c57f2-8b45-445f-997c-8f5028b9d376 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:55.779273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e0bfbf66-1a24-4fec-9691-a8090895d4ad tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "DELETE /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments/484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3" status: 202 len: 0 microversion: 2.1 time: 0.235297 Dec 15 16:14:55.780444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 341/762] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:14:55 2021] DELETE /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments/484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:14:55.790842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1883ecce-e418-46b2-a85d-7b6ae3e1d2f6 req-b1f3d52b-e54c-4e7c-9e43-8513ab29b20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}, {"name": "network-changed", "server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:55.793977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:55.793977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:14:55.806285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1883ecce-e418-46b2-a85d-7b6ae3e1d2f6 req-b1f3d52b-e54c-4e7c-9e43-8513ab29b20f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:55.807652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1883ecce-e418-46b2-a85d-7b6ae3e1d2f6 req-b1f3d52b-e54c-4e7c-9e43-8513ab29b20f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:55.822273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1883ecce-e418-46b2-a85d-7b6ae3e1d2f6 req-b1f3d52b-e54c-4e7c-9e43-8513ab29b20f service nova] Creating event network-changed:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:14:55.823500 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1883ecce-e418-46b2-a85d-7b6ae3e1d2f6 req-b1f3d52b-e54c-4e7c-9e43-8513ab29b20f service nova] Creating event network-changed:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:14:55.829115 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1883ecce-e418-46b2-a85d-7b6ae3e1d2f6 req-b1f3d52b-e54c-4e7c-9e43-8513ab29b20f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046660 Dec 15 16:14:55.834451 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 342/763] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:55 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:55.841001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:55.842322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:55.867736 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:55.868544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:55.870071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:55.870879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:55.938583 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-503a4cd2-2040-49d9-8b87-0dce368bf0f1 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101743 Dec 15 16:14:55.939700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 343/764] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:55 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:55.947081 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-64a7632a-5df7-4857-9a7f-bdd25a652cb8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'create', calling method: .version_select at 0x7f88b82ad790>, body: {"keypair": {"name": "tempest-keypair-2073304974"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:55.955794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [b78b62d1-03b5-4e5a-94bc-dbcb0673ec0f] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59582. Dec 15 16:14:55.979147 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-64a7632a-5df7-4857-9a7f-bdd25a652cb8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:14:55.981608 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c68adc27-fb2e-4df8-90ec-63799af82fcc tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733706 Dec 15 16:14:55.985259 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 422/765] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:14:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:14:55.993045 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-64a7632a-5df7-4857-9a7f-bdd25a652cb8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for user 2b01ba54246a4e8482417367b6329c1a and project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:14:55.995946 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c4593cc9-1b9d-4b08-b2ff-25fdc7189a3f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:56.008120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c4593cc9-1b9d-4b08-b2ff-25fdc7189a3f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:56.133694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c4593cc9-1b9d-4b08-b2ff-25fdc7189a3f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:56.140681 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c4593cc9-1b9d-4b08-b2ff-25fdc7189a3f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1214 microversion: 2.1 time: 0.149562 Dec 15 16:14:56.145642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 423/766] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:55 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:56.901917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-64a7632a-5df7-4857-9a7f-bdd25a652cb8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:14:56.906925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-64a7632a-5df7-4857-9a7f-bdd25a652cb8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for user 2b01ba54246a4e8482417367b6329c1a and project 4293903670af4a238fe13d805fcd9d59. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:14:56.923431 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-64a7632a-5df7-4857-9a7f-bdd25a652cb8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.982700 Dec 15 16:14:56.930549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 344/767] 10.222.0.36 () {62 vars in 1198 bytes} [Wed Dec 15 16:14:55 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 990 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:14:56.952203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:56.953275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:56.967193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:56.967786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:56.968447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:56.968885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:57.024623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0bec4edb-8321-4676-9b92-a1f50eecd5bb tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076748 Dec 15 16:14:57.029776 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 424/768] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:56 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:14:57.036603 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:57.037370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:57.046772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:57.047515 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:57.048508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:57.048936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:57.146221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] HTTP exception thrown: Instance 200c57f2-8b45-445f-997c-8f5028b9d376 is not attached to volume 484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3 Dec 15 16:14:57.147013 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Returning 404 to user: Instance 200c57f2-8b45-445f-997c-8f5028b9d376 is not attached to volume 484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3 {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:57.148246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bc778a93-d6c0-4056-8b4f-9c12ff27e187 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "DELETE /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments/484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3" status: 404 len: 154 microversion: 2.1 time: 0.116629 Dec 15 16:14:57.149956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 345/769] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:14:57 2021] DELETE /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376/os-volume_attachments/484ac6b5-a49e-411f-b4bf-c7a0ca29d8a3 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:57.162056 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:57.163502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:57.169953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:57.171460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:57.172264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:57.172693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:57.262582 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:57.274344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ba0bcfd8-ab04-4977-9f9a-2f4da0502e9f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1266 microversion: 2.1 time: 0.119831 Dec 15 16:14:57.275288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 425/770] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:57 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:58.291724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.292429 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:58.307156 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:58.307713 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:58.308517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:58.308945 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:58.333974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.335125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:58.344297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:58.344858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:58.345856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:58.346443 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:58.377973 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:58.385991 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:58.386940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-18c3ea5c-3f17-4d1c-ae06-b3bf7938930f tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1272 microversion: 2.1 time: 0.098869 Dec 15 16:14:58.387734 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 346/771] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:58.462111 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0ffdcb4-dd77-458a-b494-34729c4b4984 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "DELETE /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 204 len: 0 microversion: 2.1 time: 0.133390 Dec 15 16:14:58.463129 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 426/772] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:58 2021] DELETE /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:58.471215 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.472082 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:58.478796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:58.479244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:58.480030 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:58.480465 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:58.615852 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:58.623715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4833fb75-b80c-4213-829b-bceb010dd045 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1554 microversion: 2.1 time: 0.156295 Dec 15 16:14:58.624299 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 347/773] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:59.150445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1062778544", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed985f33-cdae-44a4-bb97-f437877d64c9"}], "security_groups": [{"name": "tempest-securitygroup--1937722492"}], "key_name": "tempest-keypair-2073304974", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:59.289348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] validate_networks() for [('ed985f33-cdae-44a4-bb97-f437877d64c9', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:14:59.404154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.405058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:59.411621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:59.412166 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:59.413117 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:59.413589 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:59.548984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:59.562629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5e948d17-b27c-4eb7-94f9-206ad302db40 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1314 microversion: 2.1 time: 0.161989 Dec 15 16:14:59.563392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 348/774] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:59.568401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-ab82ed8b-9fe4-4e7a-a7cb-30e99620a238 req-88651e12-2727-4381-a549-c00fc79bda2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae", "tag": "23b5afbb-f35f-40bd-9283-e796cb257915"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:59.571121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:59.571121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:14:59.584323 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-ab82ed8b-9fe4-4e7a-a7cb-30e99620a238 req-88651e12-2727-4381-a549-c00fc79bda2c service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:59.585493 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-ab82ed8b-9fe4-4e7a-a7cb-30e99620a238 req-88651e12-2727-4381-a549-c00fc79bda2c service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:59.597061 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-ab82ed8b-9fe4-4e7a-a7cb-30e99620a238 req-88651e12-2727-4381-a549-c00fc79bda2c service nova] Creating event network-changed:23b5afbb-f35f-40bd-9283-e796cb257915 for instance 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae on hv-cinder-80070 Dec 15 16:14:59.602400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-ab82ed8b-9fe4-4e7a-a7cb-30e99620a238 req-88651e12-2727-4381-a549-c00fc79bda2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037528 Dec 15 16:14:59.603126 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 349/775] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:59.642065 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.642771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:59.649253 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:59.649724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:59.650517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:59.650949 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:59.788695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:59.796463 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-11577cce-af2a-4fdd-b4cf-e559289dc83c tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1554 microversion: 2.1 time: 0.158247 Dec 15 16:14:59.797063 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 350/776] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:00.179345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:15:00.179873 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:15:00.180426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:15:00.180949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:15:00.181484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:15:00.190474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:00.190914 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:00.191718 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:00.192144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:00.211160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for project 4293903670af4a238fe13d805fcd9d59. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:15:00.217688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Getting quotas for user 2b01ba54246a4e8482417367b6329c1a and project 4293903670af4a238fe13d805fcd9d59. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:15:00.230179 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:15:00.232596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:15:00.285633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-285f2200-4920-4b7d-96f2-9aa26964fe96 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.140359 Dec 15 16:15:00.286692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 427/777] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Dec 15 16:14:59 2021] POST /compute/v2.1/servers => generated 402 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:15:00.297189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-23f63821-42fd-49fd-b148-7b4b5fee8203 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:00.297732 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-23f63821-42fd-49fd-b148-7b4b5fee8203 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:00.382507 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-23f63821-42fd-49fd-b148-7b4b5fee8203 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:00.392442 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-23f63821-42fd-49fd-b148-7b4b5fee8203 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:00.394397 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-23f63821-42fd-49fd-b148-7b4b5fee8203 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:00.395951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-23f63821-42fd-49fd-b148-7b4b5fee8203 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1282 microversion: 2.20 time: 0.102511 Dec 15 16:15:00.396498 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 351/778] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:00 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:00.580564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:00.581546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:00.595562 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:00.596326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:00.597332 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:00.597986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:00.815530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:00.816289 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:00.827236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:00.827880 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:00.829246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:00.829747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:00.841855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:00.853628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b716cd09-5ae5-4b94-b1ed-b8695cc260ba tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1314 microversion: 2.1 time: 0.275215 Dec 15 16:15:00.854676 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 428/779] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:00 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:01.113942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-96962c70-3a66-4e87-9800-2ae95d5b2068 req-c972c527-2312-4b7b-83a1-6f007e44d86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200c57f2-8b45-445f-997c-8f5028b9d376", "name": "network-vif-deleted", "tag": "282cd38c-1d07-4bb0-8400-a79f6db5a357"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:01.115513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:01.115513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:15:01.119857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15ca0a8cc74415815f5613f72b8105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174453a286344e0fa34d91d3ebcb8436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:01.123126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-96962c70-3a66-4e87-9800-2ae95d5b2068 req-c972c527-2312-4b7b-83a1-6f007e44d86b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:01.123568 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-96962c70-3a66-4e87-9800-2ae95d5b2068 req-c972c527-2312-4b7b-83a1-6f007e44d86b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:01.127469 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b385d76d-b289-4cbc-b762-6f2b0fed5cc3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 200 len: 1554 microversion: 2.1 time: 0.317043 Dec 15 16:15:01.128233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 352/780] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:00 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 1554 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:01.136108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-96962c70-3a66-4e87-9800-2ae95d5b2068 req-c972c527-2312-4b7b-83a1-6f007e44d86b service nova] Creating event network-vif-deleted:282cd38c-1d07-4bb0-8400-a79f6db5a357 for instance 200c57f2-8b45-445f-997c-8f5028b9d376 on hv-cinder-80070 Dec 15 16:15:01.140919 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-96962c70-3a66-4e87-9800-2ae95d5b2068 req-c972c527-2312-4b7b-83a1-6f007e44d86b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 Dec 15 16:15:01.141547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 429/781] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:01.416544 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.417558 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:01.424915 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:01.425657 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:01.426463 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:01.427069 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:01.520737 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:01.530320 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:01.531841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:01.532948 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fc58dbee-e66c-4c42-8adb-5d201f7a97d6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1342 microversion: 2.20 time: 0.122920 Dec 15 16:15:01.533555 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 353/782] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:01.872342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.873091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:01.880026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:01.880480 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:01.881278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:01.882395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:02.089905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:02.098714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8e7ec3bf-9896-440a-ae98-dbfb4244a395 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1314 microversion: 2.1 time: 0.231129 Dec 15 16:15:02.105248 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 430/783] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:02.146059 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:02.148079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] [instance: 200c57f2-8b45-445f-997c-8f5028b9d376] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:02.155837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:02.156550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:02.158154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:02.158798 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:02.184315 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] HTTP exception thrown: Instance 200c57f2-8b45-445f-997c-8f5028b9d376 could not be found. Dec 15 16:15:02.185425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Returning 404 to user: Instance 200c57f2-8b45-445f-997c-8f5028b9d376 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:15:02.186521 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-edfdd170-8c72-41fb-801c-1d6110eb8e95 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376" status: 404 len: 111 microversion: 2.1 time: 0.044922 Dec 15 16:15:02.187624 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 354/784] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:02 2021] GET /compute/v2.1/servers/200c57f2-8b45-445f-997c-8f5028b9d376 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:02.197961 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6e6cb9f3-1d48-4d62-9556-8b3840c16ce3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] Calling method '.version_select at 0x7f88b808aee0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:02.221629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6e6cb9f3-1d48-4d62-9556-8b3840c16ce3 tempest-TestMinimumBasicScenario-1568119062 tempest-TestMinimumBasicScenario-1568119062-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-930439470" status: 202 len: 0 microversion: 2.1 time: 0.028824 Dec 15 16:15:02.222781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 431/785] 10.222.0.36 () {58 vars in 1268 bytes} [Wed Dec 15 16:15:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-930439470 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:02.551869 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:02.552843 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:02.561402 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:02.562453 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:02.563484 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:02.564329 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:03.045273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:03.055844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:03.057596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:03.059050 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0b321b1c-7eda-4a2b-8448-3e573675bd13 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.510951 Dec 15 16:15:03.059762 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 355/786] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:02 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:03.117196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:03.118718 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:03.129748 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:03.132941 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:03.134116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:03.136048 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:03.418815 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-29d667af-1db4-4680-a1b7-de35c9a27407 req-4db26b8a-2933-452d-b5f9-8aa3d9220c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:03.420307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:03.420307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:15:03.427408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-29d667af-1db4-4680-a1b7-de35c9a27407 req-4db26b8a-2933-452d-b5f9-8aa3d9220c09 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:03.427844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-29d667af-1db4-4680-a1b7-de35c9a27407 req-4db26b8a-2933-452d-b5f9-8aa3d9220c09 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:03.440849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-29d667af-1db4-4680-a1b7-de35c9a27407 req-4db26b8a-2933-452d-b5f9-8aa3d9220c09 service nova] Creating event network-changed:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:15:03.451629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-29d667af-1db4-4680-a1b7-de35c9a27407 req-4db26b8a-2933-452d-b5f9-8aa3d9220c09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036819 Dec 15 16:15:03.452472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 356/787] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:03.530845 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:03.542291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bba57395-3fff-4829-8d20-a6d4f4c3fcc4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1314 microversion: 2.1 time: 0.429764 Dec 15 16:15:03.546088 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 432/788] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:03 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:04.080931 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:04.081857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:04.089178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:04.089955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:04.090962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:04.091509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:04.373664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:04.382512 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:04.384373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:04.385711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e5d6147c-3ab5-461a-ba8d-ce346ee87ec0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.310824 Dec 15 16:15:04.386447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 357/789] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:04 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:04.565765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:04.567081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:04.576721 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:04.577625 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:04.578904 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:04.579554 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:04.777119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-27e38c6f-d98c-4821-99c5-868d37a4bfc3 req-59fff52c-9fa6-4ce5-89c7-fc5207da0221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae", "name": "network-vif-plugged", "status": "completed", "tag": "23b5afbb-f35f-40bd-9283-e796cb257915"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:04.780010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:04.780010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:15:04.789700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-27e38c6f-d98c-4821-99c5-868d37a4bfc3 req-59fff52c-9fa6-4ce5-89c7-fc5207da0221 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:04.790351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-27e38c6f-d98c-4821-99c5-868d37a4bfc3 req-59fff52c-9fa6-4ce5-89c7-fc5207da0221 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:04.804781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-27e38c6f-d98c-4821-99c5-868d37a4bfc3 req-59fff52c-9fa6-4ce5-89c7-fc5207da0221 service nova] Creating event network-vif-plugged:23b5afbb-f35f-40bd-9283-e796cb257915 for instance 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae on hv-cinder-80070 Dec 15 16:15:04.810673 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-27e38c6f-d98c-4821-99c5-868d37a4bfc3 req-59fff52c-9fa6-4ce5-89c7-fc5207da0221 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039074 Dec 15 16:15:04.811817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 358/790] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:05.148778 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:05.156021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7752b36d-e277-4f61-900a-d112afc48265 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1314 microversion: 2.1 time: 0.597626 Dec 15 16:15:05.156592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 433/791] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:04 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:05.404638 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:05.405228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:05.412291 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:05.413098 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:05.414180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:05.414903 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:05.588034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:05.600671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:05.603608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:05.605017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c774d55e-7db0-442f-b23b-ea54c4854f44 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.204794 Dec 15 16:15:05.606587 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 359/792] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:05 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:06.171891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:06.172661 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:06.187350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:06.188087 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:06.188913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:06.189587 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:06.474254 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:06.483364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ae9fada-ece4-43a8-b001-95c81a0ccc54 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1314 microversion: 2.1 time: 0.315120 Dec 15 16:15:06.484071 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 434/793] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:06 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:06.623457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:06.624789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:06.634238 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:06.634950 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:06.636132 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:06.636907 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:06.942697 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:06.951466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:06.952956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:06.954124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d10cade8-3e15-4b1f-9dc7-ebb75cba97c9 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.334912 Dec 15 16:15:06.954685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 360/794] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:06 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:15:07.499915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:07.500910 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:07.511258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:07.511706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:07.512503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:07.512938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:07.748919 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:07.755973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-787a8e98-4f9a-4044-84e3-800c8450c0b5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1498 microversion: 2.1 time: 0.259845 Dec 15 16:15:07.757230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 435/795] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:07 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1498 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:07.975637 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:07.976816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:07.982887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:07.983456 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:07.984333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:07.984847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.142648 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:08.151157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:08.152977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:08.154236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0ac18ff7-e3a2-401e-9755-9b0a39f2a7eb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.185498 Dec 15 16:15:08.155017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 361/796] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:07 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:08.233633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:08.234132 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:08.240069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.240512 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.241451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.241891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.266966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:15:08.348917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e5fcaa93-3676-4a3b-9688-9ff4c1bb4890 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 204 len: 0 microversion: 2.1 time: 0.120716 Dec 15 16:15:08.349969 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 436/797] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:15:08 2021] DELETE /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:15:08.359435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:08.360192 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:08.367751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.368214 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.369048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.369515 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.512392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:08.519901 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-caa2e30f-8a6b-4198-b72c-c2a3a66d22a1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1504 microversion: 2.1 time: 0.164646 Dec 15 16:15:08.530488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 362/798] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:08 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:08.767197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1d9c82db-b832-4f4c-b0ea-cc779d8c7034 req-5296705a-25c0-4594-b178-3d287af7987f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "name": "network-vif-plugged", "status": "completed", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:08.769074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:08.769074 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:15:08.777710 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1d9c82db-b832-4f4c-b0ea-cc779d8c7034 req-5296705a-25c0-4594-b178-3d287af7987f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.778307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1d9c82db-b832-4f4c-b0ea-cc779d8c7034 req-5296705a-25c0-4594-b178-3d287af7987f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.793488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1d9c82db-b832-4f4c-b0ea-cc779d8c7034 req-5296705a-25c0-4594-b178-3d287af7987f service nova] Creating event network-vif-plugged:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:15:08.800757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1d9c82db-b832-4f4c-b0ea-cc779d8c7034 req-5296705a-25c0-4594-b178-3d287af7987f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037768 Dec 15 16:15:08.801602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 437/799] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:09.172488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:09.174272 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:09.181332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:09.182088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:09.183007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:09.183720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:09.341710 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:09.350025 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:09.351791 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:09.352905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-75dfec58-a6a3-4ed9-841c-7022fd8047ce tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.184134 Dec 15 16:15:09.353651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 363/800] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:09 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:15:09.538767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:09.539670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:09.546347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:09.546949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:09.547850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:09.548409 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:09.856513 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:09.863743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7c8eed5f-d418-48a8-ad3d-337301566c35 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1504 microversion: 2.1 time: 0.329487 Dec 15 16:15:09.864414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 438/801] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:09 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:10.371199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:10.372130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:10.379617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:10.380523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:10.382805 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:10.383479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:10.675116 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:10.697203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:10.699089 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:10.700503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c31d162-6f72-40fc-8423-56b90f9a5fe1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1408 microversion: 2.20 time: 0.333362 Dec 15 16:15:10.701293 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 364/802] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:10 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:10.882384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:10.882999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:10.899875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:10.900228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:10.901327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:10.901808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.002860 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-d9009a46-62da-4121-b658-c171da0ca79d req-be6ea8e4-c4b7-4496-9d30-e80791fa85cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae", "name": "network-vif-deleted", "tag": "23b5afbb-f35f-40bd-9283-e796cb257915"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:11.005000 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:11.005000 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:15:11.015619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-d9009a46-62da-4121-b658-c171da0ca79d req-be6ea8e4-c4b7-4496-9d30-e80791fa85cf service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.016126 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-d9009a46-62da-4121-b658-c171da0ca79d req-be6ea8e4-c4b7-4496-9d30-e80791fa85cf service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.042448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:11.051656 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-38d44718-0b10-4f65-bb55-59b3456a3336 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 200 len: 1462 microversion: 2.1 time: 0.173707 Dec 15 16:15:11.052474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 439/803] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:10 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 1462 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:11.061889 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-d9009a46-62da-4121-b658-c171da0ca79d req-be6ea8e4-c4b7-4496-9d30-e80791fa85cf service nova] Creating event network-vif-deleted:23b5afbb-f35f-40bd-9283-e796cb257915 for instance 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae on hv-cinder-80070 Dec 15 16:15:11.068085 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-d9009a46-62da-4121-b658-c171da0ca79d req-be6ea8e4-c4b7-4496-9d30-e80791fa85cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069375 Dec 15 16:15:11.068518 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 365/804] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:11.718540 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:11.719596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:11.725874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.726293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.727075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.727508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.868465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:11.876297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:11.877877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:11.879046 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d4149cb9-263e-4de6-a435-70c777491661 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1601 microversion: 2.20 time: 0.164187 Dec 15 16:15:11.879777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 440/805] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:15:11 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:11.898628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:11.899193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:11.908041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.908496 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.909282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.909747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:12.000778 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-674fb8d6-dd56-4609-a0ad-3abc65315519 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106485 Dec 15 16:15:12.001736 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 366/806] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Dec 15 16:15:11 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:15:12.071288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:12.073226 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:12.093167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:12.093680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:12.094590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:12.095051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:12.110856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] HTTP exception thrown: Instance 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae could not be found. Dec 15 16:15:12.111646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Returning 404 to user: Instance 1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:15:12.112877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-51a2f23c-d0e4-4a73-a017-cdb18662fdd1 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae" status: 404 len: 111 microversion: 2.1 time: 0.046868 Dec 15 16:15:12.113937 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 441/807] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:12 2021] GET /compute/v2.1/servers/1e6e6a3d-e016-4e87-8c6f-f1f6b1a76dae => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:12.222595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-791043524", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "12a9bd9f-1183-4bb2-81d2-63d81ac64ccf"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:12.279542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] validate_networks() for [('12a9bd9f-1183-4bb2-81d2-63d81ac64ccf', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:15:13.213501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:15:13.214077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:15:13.214379 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:15:13.214792 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:15:13.215341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:15:13.225100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.225642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.226669 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.227127 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.244322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Getting quotas for project 0ca560754a9c4530ba707aef9b98cff8. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:15:13.248242 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Getting quotas for user ffd7b536c17849f0b4b790e589c4cef0 and project 0ca560754a9c4530ba707aef9b98cff8. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:15:13.260781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:15:13.264980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:15:13.312471 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c04719f1-ce7c-416e-a39e-6be70b17c3c4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094345 Dec 15 16:15:13.313298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 367/808] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:15:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:15:13.323555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3158f082-7719-486a-a57f-add379add7fd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:13.324162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3158f082-7719-486a-a57f-add379add7fd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:13.386512 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3158f082-7719-486a-a57f-add379add7fd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:13.395037 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3158f082-7719-486a-a57f-add379add7fd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1213 microversion: 2.1 time: 0.075941 Dec 15 16:15:13.395611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 442/809] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:13 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:13.500073 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:13.501175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:13.503459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-74a4d950-93a6-4623-ac40-8c7d16b31ac9 req-3b40b409-8fcc-48fc-b30a-ac7c0d5a40f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:13.510596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:13.510596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:15:13.511018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.511692 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.512656 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.513268 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.522039 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-74a4d950-93a6-4623-ac40-8c7d16b31ac9 req-3b40b409-8fcc-48fc-b30a-ac7c0d5a40f1 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.523587 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-74a4d950-93a6-4623-ac40-8c7d16b31ac9 req-3b40b409-8fcc-48fc-b30a-ac7c0d5a40f1 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.537357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-74a4d950-93a6-4623-ac40-8c7d16b31ac9 req-3b40b409-8fcc-48fc-b30a-ac7c0d5a40f1 service nova] Creating event network-changed:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:15:13.547144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-74a4d950-93a6-4623-ac40-8c7d16b31ac9 req-3b40b409-8fcc-48fc-b30a-ac7c0d5a40f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048424 Dec 15 16:15:13.548151 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 443/810] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:13.611863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ee84efb4-ba08-42e0-9f95-62d0849fae6f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.115662 Dec 15 16:15:13.615158 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 368/811] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:13 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:14.412721 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:14.414433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:14.421114 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:14.421616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:14.422414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:14.422854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:14.494477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:14.503403 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f4174d1d-fb31-4b07-ad7e-04c91ed582e4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1273 microversion: 2.1 time: 0.094980 Dec 15 16:15:14.513284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 444/812] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:14 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:14.624814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:14.625794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:14.636976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:14.638253 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:14.640580 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:14.641005 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:14.722086 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0345dd5b-24e9-466d-92f5-6339283b5a5d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.101547 Dec 15 16:15:14.722685 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 369/813] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:14 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:15.520504 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:15.521080 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:15.528636 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.529155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.530035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.530471 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.683819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:15.693818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c96ee2f2-16a3-4a02-b0bf-f4e2d9bc7cc5 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1313 microversion: 2.1 time: 0.177094 Dec 15 16:15:15.694965 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 445/814] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:15 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:15.733206 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:15.734300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:15.740783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.741431 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.742312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.742718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.808879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3994c110-c241-4204-9bfb-6ad886dd77bb tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.079375 Dec 15 16:15:15.809677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 370/815] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:15 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:15.840072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-26346192-cec3-47a4-97c7-38142cca664d req-02c5cebe-5e7d-426b-955c-67e4812f3d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d6dbbb-302d-425d-afe4-651d0ff1ad77", "tag": "406dd020-a863-434b-bd0f-5294955fd5c2"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:15.841900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:15.841900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:15:15.849855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-26346192-cec3-47a4-97c7-38142cca664d req-02c5cebe-5e7d-426b-955c-67e4812f3d43 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.850304 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-26346192-cec3-47a4-97c7-38142cca664d req-02c5cebe-5e7d-426b-955c-67e4812f3d43 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.868321 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-26346192-cec3-47a4-97c7-38142cca664d req-02c5cebe-5e7d-426b-955c-67e4812f3d43 service nova] Creating event network-changed:406dd020-a863-434b-bd0f-5294955fd5c2 for instance a0d6dbbb-302d-425d-afe4-651d0ff1ad77 on hv-cinder-80070 Dec 15 16:15:15.872970 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-26346192-cec3-47a4-97c7-38142cca664d req-02c5cebe-5e7d-426b-955c-67e4812f3d43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037680 Dec 15 16:15:15.873605 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 446/816] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:16.711750 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:16.712853 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:16.719933 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:16.720383 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:16.721176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:16.721637 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:16.822235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:16.823596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:16.830425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:16.830954 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:16.831937 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:16.832432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:16.885891 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:16.893121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4ca8875e-b403-4ab7-a973-469d5dd3cab7 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1313 microversion: 2.1 time: 0.185767 Dec 15 16:15:16.893746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 371/817] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:16 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:16.903072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-893d3d7a-9db1-47b7-9c02-9a02eff5ba77 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.086693 Dec 15 16:15:16.903646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 447/818] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:16 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:17.915055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:17.916225 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:17.916372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:17.917299 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:17.922917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:17.923366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:17.924159 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:17.924274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:17.924645 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:17.924789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:17.925475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:17.925915 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:17.988473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8167e770-a07a-4807-8d97-f2aa2ca70bfa tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.077869 Dec 15 16:15:17.990700 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 448/819] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:17 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:18.064986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:18.072738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3831fa0c-d58c-4af1-bc9b-7d57fd406f75 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1313 microversion: 2.1 time: 0.165755 Dec 15 16:15:18.073301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 372/820] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:17 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:19.000081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:19.001080 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:19.008213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:19.008674 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:19.009475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:19.009909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:19.083880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-99747dad-4c7a-4c84-bd16-bd7b844ab65d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.087756 Dec 15 16:15:19.085500 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 449/821] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:18 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:19.089586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:19.090202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:19.096492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:19.096944 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:19.097789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:19.098336 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:19.236523 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:19.244296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f5bd5ecc-47db-4821-aabc-3f219bfff790 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1313 microversion: 2.1 time: 0.157958 Dec 15 16:15:19.244966 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 373/822] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:19 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:20.095846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:20.096848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:20.104531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.104976 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.105781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.106220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.170646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fd78ea69-c508-4080-a785-38697d405a7b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.078724 Dec 15 16:15:20.171282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 450/823] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:20 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:20.261162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:20.261841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:20.267915 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.268356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.269121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.269586 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.401841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:20.408885 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e3f3085e-022c-4ad0-ad8b-90ecdc3019f4 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1313 microversion: 2.1 time: 0.151435 Dec 15 16:15:20.409470 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 374/824] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:20 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:20.955621 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c4da2555-1414-464f-a29f-5421b029897b req-a83b204d-b6cd-4b9f-8f6e-a8c24cff3dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d6dbbb-302d-425d-afe4-651d0ff1ad77", "name": "network-vif-plugged", "status": "completed", "tag": "406dd020-a863-434b-bd0f-5294955fd5c2"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:20.957148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:20.957148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:15:20.967140 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c4da2555-1414-464f-a29f-5421b029897b req-a83b204d-b6cd-4b9f-8f6e-a8c24cff3dd0 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.967601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c4da2555-1414-464f-a29f-5421b029897b req-a83b204d-b6cd-4b9f-8f6e-a8c24cff3dd0 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.979599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c4da2555-1414-464f-a29f-5421b029897b req-a83b204d-b6cd-4b9f-8f6e-a8c24cff3dd0 service nova] Creating event network-vif-plugged:406dd020-a863-434b-bd0f-5294955fd5c2 for instance a0d6dbbb-302d-425d-afe4-651d0ff1ad77 on hv-cinder-80070 Dec 15 16:15:20.984603 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c4da2555-1414-464f-a29f-5421b029897b req-a83b204d-b6cd-4b9f-8f6e-a8c24cff3dd0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Dec 15 16:15:20.985238 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 451/825] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:21.181974 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:21.182888 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:21.188787 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:21.189232 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:21.190060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:21.190493 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:21.427589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:21.428277 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:21.434928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:21.435389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:21.436155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:21.436581 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:21.466152 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-45456fcd-052b-42e7-ac99-a8ba37bf0005 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.288222 Dec 15 16:15:21.466717 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 375/826] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:21 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:21.572659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:21.580106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bb823003-d597-4691-94bd-50cca75e25f0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1313 microversion: 2.1 time: 0.157244 Dec 15 16:15:21.580673 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 452/827] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:21 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:22.477332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:22.478466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:22.485993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.486532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.487315 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.487744 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.566009 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5bcf7597-f7e0-4deb-94c8-4771515d3dbc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.092619 Dec 15 16:15:22.566940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 376/828] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:22 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:22.597109 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:22.597821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:22.604102 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.604548 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.605329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.605794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.733656 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:22.740747 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a3677e28-2bd8-4187-b054-b859f661c9fe tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1497 microversion: 2.1 time: 0.147296 Dec 15 16:15:22.741306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 453/829] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:22 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:23.195774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:23.196340 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:23.203132 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.203567 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.204326 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.204750 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.229080 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:15:23.299145 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8d7ba391-18a6-4ef9-b8fc-acfcdd2b90bd tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 204 len: 0 microversion: 2.1 time: 0.106983 Dec 15 16:15:23.299656 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 377/830] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:15:23 2021] DELETE /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:15:23.308196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:23.308797 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:23.314742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.315183 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.315978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.316403 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.448437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:23.455725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4876b879-ae00-49c2-a27f-6d1b66429085 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1503 microversion: 2.1 time: 0.151845 Dec 15 16:15:23.456296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 454/831] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:23 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:23.577922 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:23.579099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:23.585151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.585621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.586594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.587078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.648035 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a891eaf4-4b41-4337-87df-c6a1e61302cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.073856 Dec 15 16:15:23.649497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 378/832] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:23 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:24.472342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:24.472931 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:24.480018 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:24.480466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.481244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:24.481718 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.608890 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:24.616124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-002df38c-8a35-409f-a505-4ba2d17e92b0 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1503 microversion: 2.1 time: 0.147415 Dec 15 16:15:24.616706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 455/833] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:24 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:24.659551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:24.660811 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:24.668098 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:24.668541 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.669322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:24.669781 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.736369 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0aa6c515-c60d-4c53-9513-7c2c6317d3e3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 14 microversion: 2.20 time: 0.080625 Dec 15 16:15:24.737456 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 379/834] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:24 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:25.418926 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-6e25bcae-920f-4dfe-ba42-4d4288d1cb56 req-a2c5a8f3-024a-49b7-a0e5-15d230803048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d6dbbb-302d-425d-afe4-651d0ff1ad77", "name": "network-vif-deleted", "tag": "406dd020-a863-434b-bd0f-5294955fd5c2"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:25.420761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:25.420761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:15:25.427787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-6e25bcae-920f-4dfe-ba42-4d4288d1cb56 req-a2c5a8f3-024a-49b7-a0e5-15d230803048 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.428222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-6e25bcae-920f-4dfe-ba42-4d4288d1cb56 req-a2c5a8f3-024a-49b7-a0e5-15d230803048 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.439738 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-6e25bcae-920f-4dfe-ba42-4d4288d1cb56 req-a2c5a8f3-024a-49b7-a0e5-15d230803048 service nova] Creating event network-vif-deleted:406dd020-a863-434b-bd0f-5294955fd5c2 for instance a0d6dbbb-302d-425d-afe4-651d0ff1ad77 on hv-cinder-80070 Dec 15 16:15:25.444635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-6e25bcae-920f-4dfe-ba42-4d4288d1cb56 req-a2c5a8f3-024a-49b7-a0e5-15d230803048 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029489 Dec 15 16:15:25.445843 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 456/835] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:25.634671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:25.635264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:25.642263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.642709 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.643501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.643929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.676864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.677558 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.677755 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lazy-loading 'fault' on Instance uuid a0d6dbbb-302d-425d-afe4-651d0ff1ad77 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:15:25.721182 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7b536c17849f0b4b790e589c4cef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca560754a9c4530ba707aef9b98cff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:25.728422 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5d505e4b-8066-4b68-ad97-db0a7a958614 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 200 len: 1303 microversion: 2.1 time: 0.098685 Dec 15 16:15:25.728981 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 380/836] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:25 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:25.747932 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:25.749554 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:25.755482 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.755920 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.756680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.757104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.833243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ddca5bfb-3aba-48c1-8528-14590195035d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 3831 microversion: 2.20 time: 0.089542 Dec 15 16:15:25.833916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 457/837] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:25 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 3831 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:26.747276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:26.747898 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] [instance: a0d6dbbb-302d-425d-afe4-651d0ff1ad77] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:26.756241 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.756771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.758427 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.759141 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.776149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] HTTP exception thrown: Instance a0d6dbbb-302d-425d-afe4-651d0ff1ad77 could not be found. Dec 15 16:15:26.776752 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] Returning 404 to user: Instance a0d6dbbb-302d-425d-afe4-651d0ff1ad77 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:15:26.777617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-18841339-25ad-4284-8f5b-8be5af81af04 tempest-VolumesActionsTest-2086442667 tempest-VolumesActionsTest-2086442667-project] 10.222.0.36 "GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77" status: 404 len: 111 microversion: 2.1 time: 0.035484 Dec 15 16:15:26.778409 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 381/838] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:26 2021] GET /compute/v2.1/servers/a0d6dbbb-302d-425d-afe4-651d0ff1ad77 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:26.844771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:26.848653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:26.857192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.857852 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.858698 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.859198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.965205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ce3dfc6-58a7-4b3a-9126-81d2a254cbd2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 15025 microversion: 2.20 time: 0.124372 Dec 15 16:15:26.969181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 458/839] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:26 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 15025 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:27.976088 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:27.977582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:27.983919 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:27.984368 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:27.985151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:27.985612 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:30.619274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3cb4193b-302f-41ee-81b1-fe73ce2ed02c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 22070 microversion: 2.20 time: 2.646682 Dec 15 16:15:30.620157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 382/840] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:27 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 22070 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:31.631199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:31.632229 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:31.639051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:31.639493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:31.640268 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:31.640696 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:31.724768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a9110a1d-d2bc-4769-ac1d-2d3abc9e0c50 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 23233 microversion: 2.20 time: 0.097470 Dec 15 16:15:31.725477 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 459/841] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:31 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 23233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:32.751410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:32.752637 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:32.766691 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:32.767620 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:32.768974 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:32.769747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:32.875424 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1011cf65-fb05-4e7e-92b5-c6dba60249a3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 24448 microversion: 2.20 time: 0.140111 Dec 15 16:15:32.876064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 383/842] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:32 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 24448 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:33.875068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:33.876459 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:33.889194 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:33.890863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:33.899730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:33.902591 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:33.903235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:33.903833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:33.904791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:33.905759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:33.906342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:33.907245 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:34.020072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lazy-loading 'services' on Instance uuid 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:15:34.051710 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c49ad972-6441-4718-bc35-14d1d6089c40 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 25501 microversion: 2.20 time: 0.167254 Dec 15 16:15:34.069033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 384/843] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:33 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 25501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:34.126612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f07c9a40-16ba-4866-b90b-872c1ac0744d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-volume_attachments/efd17f8a-fad3-44a0-b98e-a49820ebf20f" status: 202 len: 0 microversion: 2.1 time: 0.255739 Dec 15 16:15:34.131231 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 460/844] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:15:33 2021] DELETE /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-volume_attachments/efd17f8a-fad3-44a0-b98e-a49820ebf20f => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:35.066419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:35.067623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:35.076410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:35.077057 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:35.077956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:35.078408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:35.193619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-401caf94-b254-40df-9c2c-bdd6851b1960 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 26441 microversion: 2.20 time: 0.130966 Dec 15 16:15:35.199932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 385/845] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:35 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 26441 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:35.255094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-07c0a933-eb85-4ac3-af45-38ce01b277dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:35.263418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07c0a933-eb85-4ac3-af45-38ce01b277dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:35.264339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07c0a933-eb85-4ac3-af45-38ce01b277dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:35.289682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-07c0a933-eb85-4ac3-af45-38ce01b277dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Going to try to stop instance {{(pid=116084) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:15:35.335551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-07c0a933-eb85-4ac3-af45-38ce01b277dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 202 len: 0 microversion: 2.1 time: 0.085285 Dec 15 16:15:35.337531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 461/846] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:15:35 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:35.345665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:35.346638 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:35.373727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:35.374180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:35.376018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:35.376622 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:35.535857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:35.545124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-aa9d524c-f7b6-4cd0-9320-f69f0e0fb827 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.203627 Dec 15 16:15:35.546585 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 386/847] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:35 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:36.209650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:36.212394 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:36.221630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:36.222636 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:36.224094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:36.225274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:36.325188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-64204c42-b30a-4ab9-ad35-bf2569f165e8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 27231 microversion: 2.20 time: 0.120317 Dec 15 16:15:36.326541 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 462/848] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:36 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 27231 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:36.563298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:36.563977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:36.571492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:36.572285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:36.573155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:36.573788 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:37.053183 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:37.062186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7d77cce2-526b-44a3-ad85-76a1abb9a604 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.502311 Dec 15 16:15:37.063028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 387/849] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:36 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:37.340099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:37.341247 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:37.348032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:37.348479 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:37.349264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:37.349724 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:37.434207 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-020cdb5d-74f2-43a5-9246-351b62428734 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 27699 microversion: 2.20 time: 0.098341 Dec 15 16:15:37.435831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 463/850] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:37 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 27699 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:38.080783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:38.082155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:38.089406 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:38.090535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:38.091615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:38.092609 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:38.325673 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:38.336383 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-12078ad4-a56b-4b4f-9826-2a291432fb72 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.259002 Dec 15 16:15:38.338007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 388/851] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:38 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:38.452558 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:38.453596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:38.462331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:38.462943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:38.463944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:38.465180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:38.550522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a48d1c8d-146f-437a-8474-cd6acef8a9c5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28084 microversion: 2.20 time: 0.106518 Dec 15 16:15:38.551318 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 464/852] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:38 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28084 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:39.353659 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:39.354283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:39.360419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:39.361099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:39.361904 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:39.362509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:39.520529 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:39.534277 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-607b897f-d4b9-44a7-92c6-baddf8d6aa1b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.184612 Dec 15 16:15:39.542150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 389/853] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:39 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:39.566981 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:39.568781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:39.583945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:39.584833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:39.586593 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:39.587516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:39.697089 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9e7c637f-dc9a-4742-9fbb-1447acf35c19 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28227 microversion: 2.20 time: 0.134614 Dec 15 16:15:39.699196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 465/854] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:39 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28227 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:40.553262 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:40.555271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:40.562216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:40.562926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:40.563847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:40.564500 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:40.711693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:40.713317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:40.724122 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:40.724566 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:40.725331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:40.735560 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:40.814343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3fc54751-ffde-439e-ad72-736a8d5f99b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28227 microversion: 2.20 time: 0.107214 Dec 15 16:15:40.815358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 466/855] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:40 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28227 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:40.816580 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:40.827196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-64d24054-4fd6-40ab-96fa-91a3d281f6b7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.277475 Dec 15 16:15:40.828172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 390/856] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:40 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:41.842886 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:41.845436 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:41.846051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:41.851965 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:41.856886 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:41.857651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:41.858618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:41.858903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:41.859368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:41.859560 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:41.860163 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:41.861959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:41.948803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c2d326d6-fe0c-4c75-af10-ae963111e8d1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28518 microversion: 2.20 time: 0.124336 Dec 15 16:15:41.950292 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 467/857] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:41 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28518 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:42.021597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:42.030151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b8f17c4f-91ed-47de-8bc8-50bd331d3d4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.188159 Dec 15 16:15:42.030731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 391/858] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:41 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:42.960953 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:42.963452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:42.972470 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:42.973484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:42.974854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:42.975416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:43.048251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:43.049957 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:43.061352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:43.062369 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:43.063684 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:43.064511 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:43.071176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-46c65d22-4035-4890-8ca5-9ca0cfa57589 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28686 microversion: 2.20 time: 0.114061 Dec 15 16:15:43.072206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 468/859] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:42 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28686 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:43.235505 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:43.243670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9f6d799e-ba6b-4289-875e-bdfc2b1b3618 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.199153 Dec 15 16:15:43.244286 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 392/860] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:43 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:44.085279 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:44.086728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:44.094174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:44.094962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:44.096099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:44.096828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:44.182317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ddf1f022-8072-4807-a2c9-d866b75743c8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28686 microversion: 2.20 time: 0.100472 Dec 15 16:15:44.183112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 469/861] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:44 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28686 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:44.260858 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:44.261534 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:44.268553 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:44.268553 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:44.269651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:44.270004 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:44.428024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:44.435540 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0e399c6b-1dad-4273-8a56-d9de006c1f4c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.178199 Dec 15 16:15:44.436017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 393/862] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:44 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:45.451762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:45.452352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:45.452863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:45.453218 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:45.459535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:45.459977 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:45.460665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:45.460794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:45.461555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:45.462678 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:45.463404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:45.463746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:45.530868 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1c2d8dd5-8f5c-4c9e-86a2-8590891e18d8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28686 microversion: 2.20 time: 0.339625 Dec 15 16:15:45.535589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 470/863] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:45 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28686 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:45.627102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:45.638276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2a4025e6-b897-423f-ab58-1b8279d43e5f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1677 microversion: 2.1 time: 0.189379 Dec 15 16:15:45.639295 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 394/864] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:45 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:46.545166 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:46.546204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:46.553704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.554285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:46.555882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.556538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:46.625811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7bd2b11f-68c9-4bf8-b1cb-11c85bebe951 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 28686 microversion: 2.20 time: 0.084567 Dec 15 16:15:46.626595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 471/865] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:46 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 28686 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:46.659670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:46.661246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:46.668906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.669740 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:46.670605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.671040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:46.820047 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:46.827570 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5adc8ba4-b49f-4dc1-a59c-3c3668cbf0fd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1654 microversion: 2.1 time: 0.171509 Dec 15 16:15:46.828089 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 395/866] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:46 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:46.846987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a3585407-9c97-498e-98a8-a88dae01070b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:46.854859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3585407-9c97-498e-98a8-a88dae01070b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.855311 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3585407-9c97-498e-98a8-a88dae01070b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:46.878178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a3585407-9c97-498e-98a8-a88dae01070b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Going to try to start instance {{(pid=116084) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:15:46.920573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a3585407-9c97-498e-98a8-a88dae01070b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action" status: 202 len: 0 microversion: 2.1 time: 0.077579 Dec 15 16:15:46.921170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 472/867] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:15:46 2021] POST /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:46.929160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:46.929880 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:46.935679 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.936092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:46.936900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:46.937296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:47.102557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:47.109925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6cb324db-7050-4514-beee-a4fc063b4a4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1663 microversion: 2.1 time: 0.184299 Dec 15 16:15:47.110493 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 396/868] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:46 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:47.638713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:47.639703 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:47.645663 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:47.646110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:47.646879 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:47.647305 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:47.728992 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0232cc99-6198-47cf-a7ed-48eca1a4e62a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 29690 microversion: 2.20 time: 0.094667 Dec 15 16:15:47.729884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 473/869] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:47 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 29690 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:48.122224 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:48.123446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:48.128404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:48.129130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:48.129940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.130610 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.131613 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.132261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.139697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.139697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.139697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.139697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.164366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lazy-loading 'flavor' on Instance uuid 42cc388e-bd13-4a79-92d4-f32fcf891aaa {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:15:48.240759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c0c671db-b48e-420f-b1dc-31b7b53f60bb tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "POST /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa/action" status: 202 len: 0 microversion: 2.1 time: 0.122770 Dec 15 16:15:48.241548 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 397/870] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:15:48 2021] POST /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:48.250332 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:48.251270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:48.259823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.260457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.261428 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.262594 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.405880 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:48.410445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:48.413656 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-880fd8de-9ef5-4e97-b2a3-c66e7b0f0c02 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.167122 Dec 15 16:15:48.414555 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 398/871] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:48 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:48.418064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34cf1d08-1322-4477-b611-96f85285ac04 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1667 microversion: 2.1 time: 0.293795 Dec 15 16:15:48.418815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 474/872] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:48 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1667 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:48.740790 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:48.741762 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:48.748628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.752102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.753063 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:48.753546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:48.848737 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a1b881f7-3623-46d6-9315-351f8fbc7b4b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 31381 microversion: 2.20 time: 0.111401 Dec 15 16:15:48.849582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 399/873] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:48 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 31381 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:49.432253 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:49.432794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:49.438983 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:49.439423 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:49.440186 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:49.440611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:49.568410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:49.576258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b477ef82-8e99-4954-a438-60e05e2cf571 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.148252 Dec 15 16:15:49.576985 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 475/874] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:49 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:49.860273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:49.861267 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:49.868768 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:49.869308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:49.870410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:49.871213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:49.951954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ef47a130-49b0-407d-9c3f-24113b7e6efc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 32963 microversion: 2.20 time: 0.095540 Dec 15 16:15:49.955888 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 400/875] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:49 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 32963 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:50.593411 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:50.594021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:50.600244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:50.600688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:50.601481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:50.601974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:50.740534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:50.749337 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-65674849-d8c0-4ef3-9b48-defcd14f4d5e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.159544 Dec 15 16:15:50.750025 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 476/876] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:50 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:50.964140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:50.965379 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:50.972154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:50.972597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:50.973371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:50.973825 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:51.050360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d8b10a7c-9c99-4184-a057-ae1a9ade0ed7 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 33739 microversion: 2.20 time: 0.090256 Dec 15 16:15:51.051976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 401/877] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:50 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 33739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:51.767136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:51.767739 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:51.774120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:51.774563 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:51.775329 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:51.775757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:51.919358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:51.927997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d386ce50-bc80-4fcc-9d75-bba08529919d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.164797 Dec 15 16:15:51.928561 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 477/878] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:51 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:52.062342 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:52.063324 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:52.070149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:52.071354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:52.072120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:52.072548 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:52.151892 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f619dbdf-c4f8-4125-8783-5c7762dc961d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 34793 microversion: 2.20 time: 0.093481 Dec 15 16:15:52.152503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 402/879] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:52 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 34793 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:52.944358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.944993 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:52.951264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:52.951708 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:52.952486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:52.952917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:53.096267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:53.112091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab03f08f-cd95-45dc-be5f-317abac5fa0f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.171276 Dec 15 16:15:53.113445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 478/880] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:53.164551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:53.165578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:53.172375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:53.172820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:53.173636 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:53.174117 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:53.254526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-89a24415-55b2-4421-84f2-7fa809044fde tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 36171 microversion: 2.20 time: 0.094207 Dec 15 16:15:53.255228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 403/881] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:53 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 36171 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:54.130253 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:54.130756 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:54.137181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:54.137651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:54.138422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:54.138851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:54.266796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:54.268406 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:54.271249 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:54.275619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:54.276101 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:54.276882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:54.277310 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:54.282188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-86262bc6-7232-4449-81f3-3448f409f31c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.154335 Dec 15 16:15:54.283135 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 479/882] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:54 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:54.352987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c0f38653-7ea0-4e46-a4e6-df6b80ff1ae5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 37798 microversion: 2.20 time: 0.089451 Dec 15 16:15:54.357313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 404/883] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:54 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 37798 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:15:55.300203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:55.300777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:55.307152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:55.307592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:55.308358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:55.308781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:55.364532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:55.365913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:55.372753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:55.373198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:55.374016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:55.374628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:55.440906 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:55.450340 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7341fe90-002e-43a5-93a6-47f86de8b95f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 38243 microversion: 2.20 time: 0.089648 Dec 15 16:15:55.453425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 405/884] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:55 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 38243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:15:55.454610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-27ed3571-576f-465e-8c9f-a6885949239f tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.158006 Dec 15 16:15:55.455229 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 480/885] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:55 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:56.463550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:56.464575 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:56.471448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:56.471614 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:56.472001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:56.472152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:56.472648 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:56.473079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:56.478626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:56.479067 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:56.479847 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:56.480273 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:56.543030 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6a5cb989-d031-4339-b793-76d40d6aecc1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 38243 microversion: 2.20 time: 0.084088 Dec 15 16:15:56.547226 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 406/886] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:56 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 38243 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:56.621416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:56.629256 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9cc0523f-3305-458e-a7f3-f13c73a98764 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.161255 Dec 15 16:15:56.629906 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 481/887] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:56 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:57.555398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:57.556383 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:57.563202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:57.563647 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:57.564409 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:57.564835 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:57.642188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-42c65b8a-ea08-4799-9d78-ddc0471cbbc0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 38243 microversion: 2.20 time: 0.091239 Dec 15 16:15:57.643040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 407/888] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:57 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 38243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:15:57.646438 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:57.647072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:57.653600 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:57.654040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:57.654803 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:57.655232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:57.783652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:57.791977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e2c5407f-5251-4358-b4c0-69f8aff5e81b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.149092 Dec 15 16:15:57.792548 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 482/889] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:57 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:58.654982 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:58.655962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:58.663227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:58.663674 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:58.665047 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:58.665500 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:58.808884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:58.809516 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:58.815663 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:58.816108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:58.816880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:58.817451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:58.948584 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:58.955811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef5f174e-12d1-4175-a85b-df1c460e763c tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.151182 Dec 15 16:15:58.956403 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 483/890] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:58 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:59.973214 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.973972 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:59.980531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:59.980976 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:59.981775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:59.982201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:00.111017 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:00.118794 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ec16bb12-2b8d-449b-bcf0-29c34ac6ec2e tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.149203 Dec 15 16:16:00.119987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 484/891] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:01.136506 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:01.137141 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:01.143399 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:01.143845 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:01.144612 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:01.145055 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:01.248990 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-baa8e9e7-8d05-4a74-9e29-3d10ba3c53fe tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 200 len: 38386 microversion: 2.20 time: 2.597893 Dec 15 16:16:01.254847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 408/892] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:15:58 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 38386 bytes in 2600 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:16:01.261248 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:01.261849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:01.269547 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:01.270126 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:01.270938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:01.271367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:01.291059 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:01.298260 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d8b7c7be-0839-4a00-9d54-be28dc71fbe8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.166026 Dec 15 16:16:01.298833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 485/893] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:01 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:01.306952 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-131c2905-4172-4774-83bc-530492c95ef1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/ips" status: 200 len: 152 microversion: 2.20 time: 0.050399 Dec 15 16:16:01.307671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 409/894] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Dec 15 16:16:01 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:16:02.315364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:02.316027 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:02.323206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:02.323651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:02.324432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:02.324865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:02.469124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:02.476484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6db22751-0b2b-4f92-b9f2-81b06d047e71 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.164709 Dec 15 16:16:02.477675 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 486/895] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:02 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:03.494239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:03.494848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:03.501160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:03.501640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:03.502411 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:03.502841 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:03.566503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:03.567036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:03.573615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:03.574066 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:03.574856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:03.575283 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:03.600574 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lazy-loading 'flavor' on Instance uuid 6cc64764-e851-4cab-a602-b8669ed3aebe {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:16:03.642842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:03.651199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7bce6e6f-2846-4853-a866-6c96225b85a8 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.160973 Dec 15 16:16:03.651848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 410/896] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:03 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:03.884125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ad45deac-2f1b-4aa5-be52-14e5e7cbeeb2 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 202 len: 0 microversion: 2.20 time: 0.320671 Dec 15 16:16:03.885293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 487/897] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:16:03 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:16:03.894097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:03.894800 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:03.902287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:03.902751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:03.903753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:03.904199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:04.041672 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:04.049430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:04.050924 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:04.052093 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0c21cf1f-0878-4f81-8c54-8ea83f7d3cab tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.162515 Dec 15 16:16:04.052650 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 411/898] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:03 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:04.669191 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:04.669920 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:04.676050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:04.676493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:04.677267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:04.677746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:04.812359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:04.819976 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b6f0bc1-0b62-4b3b-aaf4-fcf15ddb7bc6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1511 microversion: 2.1 time: 0.155419 Dec 15 16:16:04.820638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 488/899] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:04 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:04.836421 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:04.836985 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:04.843157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:04.843601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:04.844368 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:04.844848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:04.916120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-348fe755-f572-43e2-8937-1d60008d54fd tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "POST /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa/action" status: 202 len: 0 microversion: 2.1 time: 0.083261 Dec 15 16:16:04.916727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 412/900] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:16:04 2021] POST /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:16:04.924520 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:04.925129 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:04.931838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:04.932291 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:04.933088 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:04.933553 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:05.072836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:05.073768 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:05.079902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:05.080620 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:05.081476 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:05.081908 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:05.090963 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:05.098615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-02f14f94-24b7-449b-aa29-dd684aa40022 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1519 microversion: 2.1 time: 0.177592 Dec 15 16:16:05.099155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 489/901] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:04 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:05.228855 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:05.237136 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:05.238845 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:05.240006 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4e7b251d-2174-4fab-8ca4-75f140892c9a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.171738 Dec 15 16:16:05.240550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 413/902] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:05 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:06.116919 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:06.117515 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:06.123849 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:06.124299 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:06.125298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:06.125772 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:06.259118 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:06.259720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:06.264339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:06.271490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe6f691d-2737-470e-bcb7-335b3c48b0d6 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.159368 Dec 15 16:16:06.277754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:06.277925 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 490/903] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:06 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:06.278049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:06.278049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:06.278049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:06.436084 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:06.448470 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:06.450242 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:06.451682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ef11806a-0d00-483a-b24f-db2446e84d31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.196948 Dec 15 16:16:06.457424 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 414/904] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:06 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:16:07.003766 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-670b94e8-63f0-4c09-8e1d-906aca0a66cf req-c24cd9b4-5725-4644-98fc-e565773175ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "name": "network-vif-unplugged", "status": "completed", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:07.005347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:07.005347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:07.013754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-670b94e8-63f0-4c09-8e1d-906aca0a66cf req-c24cd9b4-5725-4644-98fc-e565773175ed service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:07.014168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-670b94e8-63f0-4c09-8e1d-906aca0a66cf req-c24cd9b4-5725-4644-98fc-e565773175ed service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:07.026878 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-670b94e8-63f0-4c09-8e1d-906aca0a66cf req-c24cd9b4-5725-4644-98fc-e565773175ed service nova] Creating event network-vif-unplugged:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:16:07.031493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-670b94e8-63f0-4c09-8e1d-906aca0a66cf req-c24cd9b4-5725-4644-98fc-e565773175ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031363 Dec 15 16:16:07.032090 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 491/905] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:07.289955 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:07.290499 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:07.296582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:07.297024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:07.297834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:07.298248 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:07.441724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:07.449345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6e643917-acdf-4384-8489-0e2f0604e427 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.163433 Dec 15 16:16:07.449930 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 415/906] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:07 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:07.471734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:07.472427 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:07.478687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:07.479140 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:07.479914 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:07.480348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:07.614704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:07.623460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:07.624955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:07.626468 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ffd64e62-9146-4590-9141-5812154dd64b tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.159159 Dec 15 16:16:07.626704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 492/907] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:07 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:08.465757 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:08.466345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:08.472550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:08.472994 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:08.473806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:08.474238 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:08.607290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:08.614514 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-caa7b3f2-6baa-4a2c-a21c-7ddda4c2c85b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.152510 Dec 15 16:16:08.615075 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 416/908] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:08 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:08.646587 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:08.647190 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:08.654054 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:08.654507 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:08.655280 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:08.655711 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:08.786269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:08.794974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:08.796690 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:08.798306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4ebe993-5736-4032-b497-fcc519c60d18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.155350 Dec 15 16:16:08.798967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 493/909] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:08 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:09.631058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:09.631808 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:09.638793 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:09.639238 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:09.640027 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:09.640460 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:09.777415 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:09.784552 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6378628d-fa17-48b5-b42a-900f78672394 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.157101 Dec 15 16:16:09.785121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 417/910] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:09 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:09.815896 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:09.816664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:09.824124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:09.824572 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:09.825402 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:09.825844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:09.959835 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:09.968379 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:09.969917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:09.971108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-960a13fa-4a03-4e33-b99c-e059dfda123e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.158972 Dec 15 16:16:09.971676 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 494/911] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:09 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:10.801933 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:10.802526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:10.809361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:10.809842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:10.811108 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:10.811108 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:10.945112 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:10.952381 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9f8d5930-33c5-459c-9bea-2ab72c5b385b tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.154155 Dec 15 16:16:10.952951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 418/912] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:10 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:10.988432 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:10.989035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:10.995428 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:10.995871 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:10.996646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:10.997077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:11.126908 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:11.134580 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:11.136061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:11.137207 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1291fada-04d7-466e-b01e-324af1c2eec6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.152514 Dec 15 16:16:11.137810 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 495/913] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:10 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:11.969346 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:11.969921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:11.977509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:11.978074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:11.978871 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:11.979298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:12.116246 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:12.124039 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8dd2ae54-a89c-49ce-a93c-477e0e1cd499 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.158468 Dec 15 16:16:12.124602 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 419/914] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:11 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:12.155757 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:12.156380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:12.162846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:12.163288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:12.164050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:12.165008 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:12.297125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:12.305893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:12.307417 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:12.308713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-427ca6c8-2391-4a15-a655-fcdbc12f5fff tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.156724 Dec 15 16:16:12.309275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 496/915] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:12 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:13.140210 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:13.140815 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:13.147063 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:13.147509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:13.148280 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:13.149290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:13.310557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:13.317799 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5f68112b-60e1-47de-ab78-2970e187a694 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.181278 Dec 15 16:16:13.318365 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 420/916] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:13 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:13.327503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:13.328106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:13.338041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:13.338596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:13.339403 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:13.339830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:13.471331 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:13.478990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:13.480476 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:13.481658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-945afa9c-4731-450a-ac66-eab1d36ef6f1 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.157748 Dec 15 16:16:13.482222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 497/917] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:13 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:14.334480 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:14.335162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:14.342220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:14.342816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:14.343844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:14.344333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:14.500194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:14.500852 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:14.501401 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:14.509335 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-44eeeab3-45fd-41e8-bdc1-c3c562024c41 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1577 microversion: 2.1 time: 0.178427 Dec 15 16:16:14.509890 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:14.510464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 421/918] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:14 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:14.515383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:14.516205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:14.516644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:14.652732 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:14.660347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:14.662139 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:14.663310 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1b0e6199-f246-4775-9671-9715bc051c5f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.166945 Dec 15 16:16:14.663888 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 498/919] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:14 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:15.526730 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:15.527333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:15.533369 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:15.533843 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:15.534605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:15.535033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:15.672333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:15.679800 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6ca485ff-18d6-4829-82ea-80fcfda5d585 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1564 microversion: 2.1 time: 0.156789 Dec 15 16:16:15.681103 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 422/920] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:15 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:15.682694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:15.683309 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:15.689642 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:15.693036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:15.693926 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:15.694539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:15.829600 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:15.837337 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:15.838860 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:15.840011 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4cd26aa2-1489-43bd-8cde-010c19ad1ae0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.161700 Dec 15 16:16:15.840570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 499/921] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:15 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:16:16.858467 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:16.859046 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:16.865398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:16.865850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:16.866621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:16.867048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:17.007854 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:17.016727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:17.018140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:17.019527 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5ad8466a-d199-41db-b3de-f82c1c6923cc tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.164740 Dec 15 16:16:17.020105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 423/922] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:16 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:17.228927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-79f82232-8b1a-44a6-a62c-9af812115148 req-caa88321-8d96-4042-9605-58dc66717151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "name": "network-vif-plugged", "status": "completed", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:17.230531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:17.230531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:17.237171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-79f82232-8b1a-44a6-a62c-9af812115148 req-caa88321-8d96-4042-9605-58dc66717151 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:17.237644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-79f82232-8b1a-44a6-a62c-9af812115148 req-caa88321-8d96-4042-9605-58dc66717151 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:17.248219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-79f82232-8b1a-44a6-a62c-9af812115148 req-caa88321-8d96-4042-9605-58dc66717151 service nova] Creating event network-vif-plugged:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:16:17.253068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-79f82232-8b1a-44a6-a62c-9af812115148 req-caa88321-8d96-4042-9605-58dc66717151 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148994 Dec 15 16:16:17.253851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 500/923] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:18.038719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:18.039611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:18.046997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.047502 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.048294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.048729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.197784 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:18.205557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:18.207047 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:18.208216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-43fb6a62-2e33-4a85-99a6-2b014df499d0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.173492 Dec 15 16:16:18.208828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 424/924] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:18 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:19.226964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:19.227854 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:19.233850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:19.234290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:19.235058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:19.235486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:19.365676 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:19.374281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:19.375762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:19.376909 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6e85d217-4c2f-41c5-9174-5919e8b0269e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.154487 Dec 15 16:16:19.377488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 501/925] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:19 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:20.395517 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:20.396237 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:20.403067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.403512 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.404285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.404716 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.531482 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:20.539410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:20.541251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:20.542450 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ffee39e4-49cb-4cfd-82b7-ac2d5fe925f6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1746 microversion: 2.20 time: 0.150645 Dec 15 16:16:20.543027 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 425/926] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:20 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:16:21.560632 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:21.561242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:21.567541 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:21.567986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:21.568762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:21.569194 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:21.699051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:21.706886 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:21.708361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:21.709529 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66f3c524-207d-40db-b205-969fdd79bee8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1746 microversion: 2.20 time: 0.152700 Dec 15 16:16:21.710091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 502/927] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:21 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:16:22.728359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:22.728949 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:22.735251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:22.735695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:22.736467 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:22.736897 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:22.870879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:22.879342 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:22.880826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:22.882016 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ea7d02b5-add2-4e94-bc91-0ccdf5e576e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1746 microversion: 2.20 time: 0.157906 Dec 15 16:16:22.882661 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 426/928] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:22 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:23.903930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:23.905555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:23.912905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:23.913753 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:23.915563 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:23.916577 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:24.075445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:24.086288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:24.088616 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:24.089837 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b5c1a5c5-7dc5-49a1-8543-5126928980b5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.190923 Dec 15 16:16:24.090549 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 503/929] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:23 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:25.109897 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:25.111160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:25.121633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:25.122355 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:25.123328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:25.123913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:25.149787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-dd90c665-7833-4f6a-a001-be3edef387dd req-4b13ae76-d092-409b-8561-32213659b3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "name": "network-vif-plugged", "status": "completed", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:25.151955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:25.151955 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:25.160818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-dd90c665-7833-4f6a-a001-be3edef387dd req-4b13ae76-d092-409b-8561-32213659b3cc service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:25.161322 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-dd90c665-7833-4f6a-a001-be3edef387dd req-4b13ae76-d092-409b-8561-32213659b3cc service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:25.178141 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-dd90c665-7833-4f6a-a001-be3edef387dd req-4b13ae76-d092-409b-8561-32213659b3cc service nova] Creating event network-vif-plugged:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:16:25.187641 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-dd90c665-7833-4f6a-a001-be3edef387dd req-4b13ae76-d092-409b-8561-32213659b3cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041961 Dec 15 16:16:25.190177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 504/930] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:25.286328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:25.295662 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:25.297157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:25.298375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-94bddbc6-c32d-43dc-83d4-645f8e5903ba tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.193445 Dec 15 16:16:25.299256 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 427/931] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:25 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:26.317812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:26.318527 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:26.326487 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.327224 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.328041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.328482 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.481129 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:26.489064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:26.490603 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:26.491754 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5c89b5fa-7808-42be-ac5c-9f6a8dc530d3 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.178900 Dec 15 16:16:26.492319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 505/932] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:26 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:27.510958 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:27.511819 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:27.518987 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:27.519864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:27.521508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:27.522180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:27.682719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:27.692617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:27.694146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:27.695361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e192f465-a6d2-47e9-8eeb-9384d4808a3e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.188588 Dec 15 16:16:27.696674 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 428/933] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:27 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:28.713991 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:28.715217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:28.721606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:28.722348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:28.723192 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:28.723695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:28.874664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:28.884201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:28.885828 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:28.887230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe1923e9-4178-4c27-9ce5-c5d402ad8439 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.177021 Dec 15 16:16:28.888009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 506/934] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:28 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:29.906588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:29.908307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:29.918251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:29.919092 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:29.920221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:29.920886 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.136188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:30.145097 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:30.146794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:30.148252 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-472ebe5c-8749-40f3-aaf6-c9346d369b85 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.245954 Dec 15 16:16:30.149350 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 429/935] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:29 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:30.336284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:30.337243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:30.345676 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.346118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.346881 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.347490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.381592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f0c03e24-07db-4261-a629-c87c41819ce3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050217 Dec 15 16:16:30.382424 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 507/936] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:16:30 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:16:30.450053 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:30.450838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:30.457702 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.458150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.458929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.461678 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.507341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:16:30.620723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1b80acc0-f7da-4f7d-b74b-42db49667c81 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 204 len: 0 microversion: 2.1 time: 0.174377 Dec 15 16:16:30.633013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:30.633691 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:30.639302 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 430/937] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:16:30 2021] DELETE /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:16:30.641013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.641493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.642286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.642722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.802965 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:30.810547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c9702a40-5dad-496d-af25-6cee4afb6bec tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1673 microversion: 2.1 time: 0.183017 Dec 15 16:16:30.811138 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 508/938] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:30 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:31.168483 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:31.169790 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:31.177370 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.178401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.179564 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.180394 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.349506 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:31.357629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:31.359340 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:31.360642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0ea4e0e3-11c9-4575-b7af-9e91fa845e70 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.197147 Dec 15 16:16:31.372248 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 431/939] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:31 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:31.829143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:31.830126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:31.837308 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.837774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.838771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.839201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.997334 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:32.006999 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-311dc9a4-120d-4206-9bdf-f2f8ee44d0b4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1673 microversion: 2.1 time: 0.182009 Dec 15 16:16:32.018634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 509/940] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:31 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:32.378834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:32.380119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:32.393276 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:32.394251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:32.395109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:32.395632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:32.553659 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:32.561882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:32.563455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:32.565704 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-15c463fe-9425-48dd-8ce8-06f3203d6d3d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1741 microversion: 2.20 time: 0.190660 Dec 15 16:16:32.566488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 432/941] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:32 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:32.639791 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1737589269", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:32.695302 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] validate_networks() for None {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:16:33.000124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:16:33.000660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:16:33.001008 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:16:33.001435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:16:33.001853 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:16:33.011855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.012307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.013125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.013815 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.025057 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:33.026196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:33.031626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Getting quotas for project 767457cee9584e02afc690428a89a898. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:16:33.035668 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Getting quotas for user f4de2a2126b2414896bcf84605ec5760 and project 767457cee9584e02afc690428a89a898. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:16:33.040881 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.042606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.043887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.044629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.049193 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:16:33.051572 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:16:33.107474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eb9fc757-f33e-4183-8e80-f7e6f339c1f8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471306 Dec 15 16:16:33.108531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 510/942] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:16:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:16:33.122275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9a2aff92-cf3a-4d40-9473-1e1a15c0bbd8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:33.124116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9a2aff92-cf3a-4d40-9473-1e1a15c0bbd8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:33.185197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9a2aff92-cf3a-4d40-9473-1e1a15c0bbd8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:33.193266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9a2aff92-cf3a-4d40-9473-1e1a15c0bbd8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1215 microversion: 2.1 time: 0.076199 Dec 15 16:16:33.197488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 511/943] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:33 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:33.281673 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:33.290774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3b0ef836-b9c6-43a4-9191-e2217e3890b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1673 microversion: 2.1 time: 0.268633 Dec 15 16:16:33.291625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 433/944] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:33 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:33.585491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:33.586293 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:33.597509 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.598056 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.599001 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.599436 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.749811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:33.759940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:33.769653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:33.771176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b69604d3-2a36-4b76-aabb-abb6f8cdff02 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1723 microversion: 2.20 time: 0.189389 Dec 15 16:16:33.771901 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 512/945] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:33 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:34.210632 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:34.211373 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:34.223850 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.228098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.232051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.232697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.457224 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:34.465219 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-11aec411-68fa-4907-973d-1386a78d1c2b req-e861689a-e098-4c50-a4e3-2a5538c63664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e", "name": "network-vif-deleted", "tag": "22b2ec2e-29af-439e-80e6-b88c63e49caf"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:34.468649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:34.468649 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:16:34.471062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-394851d1-25ac-45fa-a6ed-9a245136271b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1275 microversion: 2.1 time: 0.263395 Dec 15 16:16:34.472681 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 513/946] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:34 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:34.480018 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:34.480869 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:34.488328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-11aec411-68fa-4907-973d-1386a78d1c2b req-e861689a-e098-4c50-a4e3-2a5538c63664 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.488972 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.489102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-11aec411-68fa-4907-973d-1386a78d1c2b req-e861689a-e098-4c50-a4e3-2a5538c63664 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.491082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.493578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.494266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.516379 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-11aec411-68fa-4907-973d-1386a78d1c2b req-e861689a-e098-4c50-a4e3-2a5538c63664 service nova] Creating event network-vif-deleted:22b2ec2e-29af-439e-80e6-b88c63e49caf for instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e on hv-cinder-80070 Dec 15 16:16:34.525617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-11aec411-68fa-4907-973d-1386a78d1c2b req-e861689a-e098-4c50-a4e3-2a5538c63664 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368922 Dec 15 16:16:34.529157 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 434/947] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:34.539737 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.540200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.540653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lazy-loading 'fault' on Instance uuid 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:16:34.583579 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:34.592127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-026e29da-08ee-492c-9dd6-667edb4637dd tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 200 len: 1327 microversion: 2.1 time: 0.117900 Dec 15 16:16:34.592715 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 514/948] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:34 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:34.793717 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:34.794927 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:34.801448 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.802408 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.803366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.803961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:35.072704 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:35.080835 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:35.082526 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:35.083992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-43616bfe-7863-49ac-b9b4-aa587d2d31d5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1723 microversion: 2.20 time: 0.295243 Dec 15 16:16:35.084773 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 435/949] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:34 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:35.174418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-58cafe5f-5864-4d2e-8fce-323a876bfbf1 req-b4f52c16-a38a-4716-bcb6-59719a7f1d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "name": "network-vif-unplugged", "status": "completed", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:35.176533 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:35.176533 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:35.185012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-58cafe5f-5864-4d2e-8fce-323a876bfbf1 req-b4f52c16-a38a-4716-bcb6-59719a7f1d4d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:35.185481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-58cafe5f-5864-4d2e-8fce-323a876bfbf1 req-b4f52c16-a38a-4716-bcb6-59719a7f1d4d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:35.200359 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-58cafe5f-5864-4d2e-8fce-323a876bfbf1 req-b4f52c16-a38a-4716-bcb6-59719a7f1d4d service nova] Creating event network-vif-unplugged:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:16:35.205484 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-58cafe5f-5864-4d2e-8fce-323a876bfbf1 req-b4f52c16-a38a-4716-bcb6-59719a7f1d4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034595 Dec 15 16:16:35.206467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 515/950] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:35.487910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:35.488430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:35.496321 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:35.497220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:35.501745 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:35.501745 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:35.611305 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:35.612040 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:35.618720 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:35.619126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:35.620361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:35.621056 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:35.636038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] HTTP exception thrown: Instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e could not be found. Dec 15 16:16:35.636659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Returning 404 to user: Instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:16:35.637527 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b809bfc2-ef90-4415-a909-cb44f39c4653 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 404 len: 111 microversion: 2.1 time: 0.031788 Dec 15 16:16:35.638077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 516/951] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:35 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:35.645878 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc920819-d792-474b-ae2f-4a8440dcc98e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '.version_select at 0x7f88abf77b80>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:35.664902 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc920819-d792-474b-ae2f-4a8440dcc98e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-426090185" status: 202 len: 0 microversion: 2.1 time: 0.022197 Dec 15 16:16:35.666491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 517/952] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Dec 15 16:16:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-426090185 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:16:35.781274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:35.789139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1414ed6f-d390-45e5-aa60-65c7b08a96af tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.304761 Dec 15 16:16:35.791070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 436/953] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:35 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:36.103767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:36.104722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:36.111394 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:36.112113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.113130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:36.113781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.417228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-25416126-3c5a-4633-917d-6cf96f79616b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: .version_select at 0x7f88b81c1550>, body: {"keypair": {"name": "tempest-keypair-618585747"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:36.436098 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-25416126-3c5a-4633-917d-6cf96f79616b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:16:36.440095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-25416126-3c5a-4633-917d-6cf96f79616b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for user ff251ac504444235af8055f7a9c8e0a5 and project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:16:36.474733 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:36.493660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:36.495880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:36.497567 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a894b21b-272c-4582-8a48-9ae81e2eeeb6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1723 microversion: 2.20 time: 0.398823 Dec 15 16:16:36.498345 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 518/954] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:36 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:36.581286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-4ac95106-640b-43cf-81c0-d938ad6bc5dc req-b414662e-f0aa-4173-a7fb-a28c305d0f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bbab0f-7ee0-4ef7-adc9-94502d92a5bf", "tag": "db8bbec1-5dba-44c7-8b58-c7a0af255d94"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:36.583061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:36.583061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:36.590182 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4ac95106-640b-43cf-81c0-d938ad6bc5dc req-b414662e-f0aa-4173-a7fb-a28c305d0f7c service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:36.590925 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4ac95106-640b-43cf-81c0-d938ad6bc5dc req-b414662e-f0aa-4173-a7fb-a28c305d0f7c service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.603627 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-4ac95106-640b-43cf-81c0-d938ad6bc5dc req-b414662e-f0aa-4173-a7fb-a28c305d0f7c service nova] Creating event network-changed:db8bbec1-5dba-44c7-8b58-c7a0af255d94 for instance 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf on hv-cinder-80070 Dec 15 16:16:36.608244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-4ac95106-640b-43cf-81c0-d938ad6bc5dc req-b414662e-f0aa-4173-a7fb-a28c305d0f7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030897 Dec 15 16:16:36.608813 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 519/955] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:16:36.808808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:36.809648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:36.822690 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:36.824966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.826998 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:36.827692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.983433 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-25416126-3c5a-4633-917d-6cf96f79616b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:16:36.987354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-25416126-3c5a-4633-917d-6cf96f79616b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for user ff251ac504444235af8055f7a9c8e0a5 and project 710c6a0383874f9b946e8376a79787b6. Resources: {'key_pairs'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:16:37.003142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-25416126-3c5a-4633-917d-6cf96f79616b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.591310 Dec 15 16:16:37.004069 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 437/956] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 16:16:36 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:37.045500 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:37.059637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9402d64f-66ee-46c4-8021-160d70c29d8a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.256091 Dec 15 16:16:37.060125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 520/957] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:36 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:37.515425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:37.516036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:37.521675 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.522317 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.523107 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.523540 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.654167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:37.662166 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:37.663967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:37.665838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2a30ed1c-22c6-4cb1-92b6-8c8120532499 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1666 microversion: 2.20 time: 0.154127 Dec 15 16:16:37.666402 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 438/958] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:37 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:37.684366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60d95251-6c2a-4ef8-88a6-da9f4d548679"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:37.685424 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:37.691139 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.691579 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.692353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.692781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.970205 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d2d2838f-6b64-4c18-b0eb-e34eee56b0e6 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290085 Dec 15 16:16:37.970906 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 521/959] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Dec 15 16:16:37 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:16:38.076361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:38.076966 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:38.083527 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.083971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.084766 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.085192 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.088488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:38.088975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:38.095322 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.095858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.096723 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.097225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.246621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:38.254468 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bd9121e1-b25e-4325-95e9-d3f8ce9d195a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.181400 Dec 15 16:16:38.255437 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 439/960] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:38 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:38.346503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ddf00962-6f81-4c63-b71a-09fdf7ae1852 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-volume_attachments/60d95251-6c2a-4ef8-88a6-da9f4d548679" status: 202 len: 0 microversion: 2.20 time: 0.263256 Dec 15 16:16:38.347204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 522/961] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Dec 15 16:16:38 2021] DELETE /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-volume_attachments/60d95251-6c2a-4ef8-88a6-da9f4d548679 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:16:38.402474 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:38.403112 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:38.409114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.409687 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.410534 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.411035 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.488193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9b1a859d-dccb-489b-813e-5e911bb58854 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action" status: 202 len: 0 microversion: 2.20 time: 0.089543 Dec 15 16:16:38.488884 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 440/962] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Dec 15 16:16:38 2021] POST /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:16:38.497276 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:38.497927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:38.504204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.504855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.505805 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.506244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.639202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1707051255", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b76a42d-a289-476f-a87a-d1a85520dc8f"}], "security_groups": [{"name": "tempest-securitygroup--1534717734"}], "key_name": "tempest-keypair-618585747", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:38.689525 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:38.698241 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:38.700597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:38.702303 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-becaa1db-3520-4013-a2b3-86c7142bca07 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1674 microversion: 2.20 time: 0.208927 Dec 15 16:16:38.703071 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 523/963] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:38 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:38.748470 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] validate_networks() for [('8b76a42d-a289-476f-a87a-d1a85520dc8f', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:16:39.233079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:16:39.233616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:16:39.233986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:16:39.234416 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:16:39.234821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:16:39.243503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.243940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.244739 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.245165 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.260475 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for project 710c6a0383874f9b946e8376a79787b6. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:16:39.264189 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Getting quotas for user ff251ac504444235af8055f7a9c8e0a5 and project 710c6a0383874f9b946e8376a79787b6. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:16:39.273155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:39.273986 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:39.276646 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:16:39.279035 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:16:39.280539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.280987 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.281804 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.282242 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.327771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d89f96bd-c7fb-4718-8486-f0b72edcd391 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.693992 Dec 15 16:16:39.328608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 441/964] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:16:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:16:39.338864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-940a8d8d-7bc6-444a-b153-fb49e536fb1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:39.339592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-940a8d8d-7bc6-444a-b153-fb49e536fb1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:39.398960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-940a8d8d-7bc6-444a-b153-fb49e536fb1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:39.408330 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-940a8d8d-7bc6-444a-b153-fb49e536fb1d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1237 microversion: 2.1 time: 0.073604 Dec 15 16:16:39.409089 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 442/965] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:39 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:39.423962 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:39.432463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-71708c97-ae83-4661-a1a0-1173fc291758 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.162935 Dec 15 16:16:39.433029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 524/966] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:39 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:39.720838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:39.721864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:39.729221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.729836 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.730822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.731580 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.972013 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:39.980223 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:39.981838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:39.983079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8ca42bdb-46d0-4a5f-a1af-8e3313d80b31 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.266078 Dec 15 16:16:39.983770 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 443/967] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:39 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:40.425319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:40.426051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:40.433290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:40.433768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:40.434565 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:40.435030 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:40.453330 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:40.454110 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:40.462643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:40.463288 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:40.464226 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:40.464845 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:40.522788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:40.531463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9f27d1da-b5fa-418f-b390-9ac2fcb4d287 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1295 microversion: 2.1 time: 0.109868 Dec 15 16:16:40.532269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 525/968] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:40 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1295 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:40.690842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:40.700335 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ad729601-e107-49fe-990b-bbe76a080fdc tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.254108 Dec 15 16:16:40.701757 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 444/969] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:40 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:41.003417 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:41.004036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:41.010320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:41.010776 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:41.011570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:41.012180 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:41.219097 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:41.231130 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:41.233318 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:41.234973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1be9024a-73a8-496e-92bc-0a57c240f10d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.235403 Dec 15 16:16:41.258702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 526/970] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:40 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:41.547880 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:41.549167 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:41.567298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:41.568154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:41.569186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:41.569986 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:41.709719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:41.719777 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d973d7cc-5c44-45c7-9fcf-adccbdf30000 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.175368 Dec 15 16:16:41.720960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 445/971] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:41 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:41.721284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:41.721923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:41.729154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:41.729911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:41.730942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:41.731585 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:41.898557 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:41.907588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7acf8a2d-7600-43fd-9d1c-427cbb002060 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.192684 Dec 15 16:16:41.908089 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 527/972] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:41 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:42.253331 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:42.254007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:42.260109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:42.260635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:42.261529 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:42.262032 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:42.406312 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:42.415909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:42.417537 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:42.418698 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-92bb8172-aa7e-4cfa-94b5-cb1c3912c1f8 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.169141 Dec 15 16:16:42.419471 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 446/973] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:42 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:42.737295 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:42.737916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:42.744933 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:42.745410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:42.746198 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:42.746823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:42.879809 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:42.887743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-38d6845f-ed6a-4aa7-aa75-b367fe45eeaf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.154176 Dec 15 16:16:42.888325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 528/974] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:42 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:42.925035 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:42.925671 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:42.932214 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:42.932655 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:42.933464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:42.933905 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:43.074138 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:43.086782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-832c201d-f622-4181-b71d-8b065d10e6f7 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.164937 Dec 15 16:16:43.087255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 447/975] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:42 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:43.234948 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-72edfd44-0b95-4505-8ceb-9b6c93ff2c5e req-a4636121-1993-4ed2-a7e8-b84a05e17508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbab0f-7ee0-4ef7-adc9-94502d92a5bf", "name": "network-vif-plugged", "status": "completed", "tag": "db8bbec1-5dba-44c7-8b58-c7a0af255d94"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:43.236723 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:43.236723 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:43.261518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-72edfd44-0b95-4505-8ceb-9b6c93ff2c5e req-a4636121-1993-4ed2-a7e8-b84a05e17508 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:43.262506 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-72edfd44-0b95-4505-8ceb-9b6c93ff2c5e req-a4636121-1993-4ed2-a7e8-b84a05e17508 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:43.277709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-72edfd44-0b95-4505-8ceb-9b6c93ff2c5e req-a4636121-1993-4ed2-a7e8-b84a05e17508 service nova] Creating event network-vif-plugged:db8bbec1-5dba-44c7-8b58-c7a0af255d94 for instance 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf on hv-cinder-80070 Dec 15 16:16:43.282743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-72edfd44-0b95-4505-8ceb-9b6c93ff2c5e req-a4636121-1993-4ed2-a7e8-b84a05e17508 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051737 Dec 15 16:16:43.283591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 529/976] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:43.437853 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:43.438581 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:43.444626 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:43.445155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:43.445993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:43.446554 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:43.587942 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:43.596216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:43.597749 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:43.598916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-40c9cbd2-e6a9-4db1-8d80-6a897a746656 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.165566 Dec 15 16:16:43.599477 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 448/977] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:43 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:43.906289 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:43.906977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:43.913264 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:43.913740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:43.914574 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:43.915658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:44.054702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:44.062445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-db2854cb-dc18-4225-8be5-b799365d68a1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.160587 Dec 15 16:16:44.063011 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 530/978] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:43 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:44.109890 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:44.110507 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:44.116727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:44.117178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:44.118562 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:44.119359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:44.261933 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:44.269140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-12dfdc4f-6b77-405a-aae8-1d8cb94620b8 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.163055 Dec 15 16:16:44.269761 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 449/979] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:44 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:44.620120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:44.620737 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:44.626932 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:44.627383 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:44.628177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:44.628615 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:44.768800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:44.777333 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:44.778862 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:44.780033 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8bc0ae86-3e97-4ca3-b8d1-205cf3640e24 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.166365 Dec 15 16:16:44.780832 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 531/980] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:44 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:45.079794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:45.080530 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:45.086473 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:45.087006 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:45.087866 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:45.088373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:45.224960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:45.234148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bb2be2e8-92b6-4d9f-b299-5ff92a8b866c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.157933 Dec 15 16:16:45.234931 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 450/981] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:45 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:45.285859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:45.286471 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:45.293222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:45.293768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:45.294501 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:45.294934 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:45.447347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:45.454846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e7a62f61-2ffb-4fa6-97cc-74715a0c5630 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.172681 Dec 15 16:16:45.455412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 532/982] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:45 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:45.798209 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:45.798817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:45.804760 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:45.805210 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:45.806359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:45.806867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:45.949137 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:45.957513 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:45.958998 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:45.960149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-377a6608-c187-46c5-9b45-e294ff6cd763 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.165658 Dec 15 16:16:45.960705 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 451/983] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:45 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:46.252211 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:46.253149 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:46.259488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:46.259936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:46.260731 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:46.261178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:46.400108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:46.407735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-de741f96-d10f-461d-aca5-8475d6eee657 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.159107 Dec 15 16:16:46.408318 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 533/984] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:46 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:46.471098 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:46.471741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:46.479278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:46.479751 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:46.480535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:46.480973 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:46.620925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:46.628767 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8085e38e-bb46-48b1-ab67-4c6db4f5c7cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.161307 Dec 15 16:16:46.629551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 452/985] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:46 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:46.981031 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:46.981764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:46.989763 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:46.990261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:46.991032 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:46.991465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:47.138190 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:47.146811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:47.148298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:47.150278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-259d1063-22d5-4b96-a189-0c8ff0aa644d tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.174402 Dec 15 16:16:47.155676 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 534/986] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:46 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:47.426556 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:47.427089 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:47.434595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:47.435051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:47.435855 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:47.436296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:47.585099 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:47.592405 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-351dfb32-70eb-4442-9183-7d3e5c1848b3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.169593 Dec 15 16:16:47.592971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 453/987] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:47 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:47.649284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:47.650716 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:47.657984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:47.658439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:47.659235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:47.659672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:47.797746 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:47.805452 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ae4154fc-ce95-4385-878c-461d917641dd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.160929 Dec 15 16:16:47.806906 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 535/988] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:47 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:48.170466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:48.171063 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:48.177036 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:48.177507 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:48.178294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:48.178724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:48.320077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:48.328975 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:48.330813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:48.332079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-658a4e50-8ea4-4861-8dc3-48649f251544 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.165759 Dec 15 16:16:48.332895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 454/989] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:48 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:16:48.609838 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:48.611368 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:48.621891 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:48.622346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:48.623147 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:48.623579 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:48.767467 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:48.775286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-92d5c3d5-6ecc-4cfb-bb16-006740508d94 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.170013 Dec 15 16:16:48.775840 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 536/990] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:48 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:48.823162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:48.823938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:48.830476 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:48.830925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:48.831710 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:48.832144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:48.971202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:48.978347 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7e374586-a7c1-4584-b7d7-28123b6da993 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.159247 Dec 15 16:16:48.978917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 455/991] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:48 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:49.350927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:49.351527 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:49.358018 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:49.358464 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:49.359228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:49.359656 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:49.500725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:49.508762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:49.510702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:49.511877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-09891c09-9854-4e9a-b0b9-2b79abe2070f tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.164777 Dec 15 16:16:49.512437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 537/992] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:49 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:49.792902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:49.793472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:49.799254 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:49.799691 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:49.800447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:49.800873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:49.948489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:49.955728 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-46e345b9-7c17-43dc-8547-c5e44bb77057 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.167207 Dec 15 16:16:49.956294 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 456/993] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:49 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:49.995784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:49.996394 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:50.002867 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:50.003310 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:50.004098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:50.004538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:50.145701 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:50.153050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-946ee8ad-5599-4f45-a744-b6bf9a5b2d5d tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.161370 Dec 15 16:16:50.153660 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 538/994] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:49 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:50.531481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:50.532491 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:50.541641 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:50.542236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:50.543554 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:50.544277 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:50.688891 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:50.699851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:50.702270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:50.703852 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ee3c641d-573e-4f30-8b91-4117bbbc183e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.176769 Dec 15 16:16:50.704606 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 457/995] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:50 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:50.972751 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:50.973353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:50.979523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:50.980282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:50.980784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:50.981249 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:51.120380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:51.127655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d79f0cd-c7b9-40cd-8207-dfc657a6887f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.158579 Dec 15 16:16:51.128204 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 539/996] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:50 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:51.169372 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:51.169998 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:51.176120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:51.176566 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:51.177333 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:51.177786 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:51.313068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:51.320251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b4c024b4-71c8-4ee3-b431-9bbcda402d7a tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.154421 Dec 15 16:16:51.320814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 458/997] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:51 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:51.723519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:51.724123 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:51.730024 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:51.730478 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:51.731266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:51.731706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:51.908100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:51.916666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:51.918219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:51.919419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5e7b17dc-3516-48c2-98d0-f78587562ac0 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.199836 Dec 15 16:16:51.919974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 540/998] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:51 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:52.145058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:52.145696 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:52.153220 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.154060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:52.156968 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.157663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:52.337480 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:52.338082 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:52.344458 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.344907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:52.345800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.346139 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:52.437916 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:52.445600 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8fc963e5-914d-4140-abda-2d2092329555 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.303935 Dec 15 16:16:52.447374 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 459/999] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:52 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:52.485811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:52.493490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e3da682d-0e2b-4228-985c-857af21ef7db tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1315 microversion: 2.1 time: 0.159492 Dec 15 16:16:52.494315 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 541/1000] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:52 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:52.585811 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-f6794224-d8a3-4b00-be27-88f185376723 req-b50043a5-fb59-49f1-84a2-3e8ee775da99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f10094-2d7d-44fa-9078-a104e2e6ef84", "tag": "ae641ced-6e64-46f2-ad18-9b3191eb38ed"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:52.589677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:52.589677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:16:52.600618 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f6794224-d8a3-4b00-be27-88f185376723 req-b50043a5-fb59-49f1-84a2-3e8ee775da99 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.601068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-f6794224-d8a3-4b00-be27-88f185376723 req-b50043a5-fb59-49f1-84a2-3e8ee775da99 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:52.625072 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-f6794224-d8a3-4b00-be27-88f185376723 req-b50043a5-fb59-49f1-84a2-3e8ee775da99 service nova] Creating event network-changed:ae641ced-6e64-46f2-ad18-9b3191eb38ed for instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 on hv-cinder-80070 Dec 15 16:16:52.632736 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-f6794224-d8a3-4b00-be27-88f185376723 req-b50043a5-fb59-49f1-84a2-3e8ee775da99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051681 Dec 15 16:16:52.633355 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 460/1001] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:52.937630 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:52.938238 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:52.944023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.944473 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:52.945651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:52.946097 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.094752 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:53.103227 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:53.104924 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:53.106339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eb5af5ef-8dfd-43e2-bbd2-27792a7b3220 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.172426 Dec 15 16:16:53.106905 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 542/1002] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:52 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:53.464142 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:53.464840 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:53.471706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.472186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.473100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.473571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.511526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:53.512171 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:53.518611 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.519068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.519858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.520297 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.655104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:53.668597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f84e2476-3a84-458f-a6de-1e515ccc22f2 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1463 microversion: 2.1 time: 0.161303 Dec 15 16:16:53.669196 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 543/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:53 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:53.706230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:53.706812 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:53.712777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.713245 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.714060 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.714490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.738127 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:53.739468 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:16:53.746479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2bfe1301-876c-432a-b190-cb72836b6576 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.286308 Dec 15 16:16:53.747222 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 461/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:53 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:53.815124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ec22f0b-2b71-4a5a-b68e-322c21abc2e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "DELETE /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 204 len: 0 microversion: 2.1 time: 0.112101 Dec 15 16:16:53.815721 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 544/1005] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:16:53 2021] DELETE /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:16:53.825647 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:53.826264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:53.832241 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.832689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.833502 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:53.833939 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:53.967302 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:53.974468 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fa6699e3-e0a1-4a64-b48e-07c9d7cbca8b tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1469 microversion: 2.1 time: 0.154009 Dec 15 16:16:53.975058 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 462/1006] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:53 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:54.125170 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:54.125894 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:54.131806 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:54.132256 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:54.133021 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:54.133481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:54.264259 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:54.271928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:54.273425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:54.275126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-99848ed2-86f9-4363-abc9-c68048b82237 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.153559 Dec 15 16:16:54.275685 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 545/1007] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:54 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:54.765265 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:54.766105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:54.774354 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:54.775213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:54.776228 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:54.776774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:54.914325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:54.921553 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6490d40c-c7c2-46f0-9788-1bd71507bc2d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.161709 Dec 15 16:16:54.922121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 463/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:54 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:54.992178 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:54.992800 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:54.999479 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:54.999922 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:55.000693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:55.001124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:55.135904 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:55.143245 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8ee55125-a179-4a6f-ae04-3bdb909f01e3 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1469 microversion: 2.1 time: 0.154712 Dec 15 16:16:55.143818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 546/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:54 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:55.293598 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:55.294325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:55.300383 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:55.300815 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:55.301625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:55.302051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:55.815258 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:55.824078 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:55.825592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:55.826814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-e23c2645-cc28-4bb3-8f26-c60c89605da5 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.537232 Dec 15 16:16:55.827377 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 464/1010] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:55 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:55.938650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:55.939271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:55.945278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:55.945826 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:55.946644 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:55.947203 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:56.096379 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:56.104740 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ebb44f6d-70ca-43f7-a7e7-519a12789511 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.169698 Dec 15 16:16:56.114916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 547/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:55 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:56.161008 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:56.161999 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:56.172168 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:56.173191 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:56.174214 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:56.175239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:56.188930 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-8cad00bc-8a47-4256-a885-f891c35aed97 req-befa651b-7922-4c39-9135-af06593ebb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbab0f-7ee0-4ef7-adc9-94502d92a5bf", "name": "network-vif-deleted", "tag": "db8bbec1-5dba-44c7-8b58-c7a0af255d94"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:56.190911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:56.190911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:56.198846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8cad00bc-8a47-4256-a885-f891c35aed97 req-befa651b-7922-4c39-9135-af06593ebb73 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:56.199494 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8cad00bc-8a47-4256-a885-f891c35aed97 req-befa651b-7922-4c39-9135-af06593ebb73 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:56.217165 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-8cad00bc-8a47-4256-a885-f891c35aed97 req-befa651b-7922-4c39-9135-af06593ebb73 service nova] Creating event network-vif-deleted:db8bbec1-5dba-44c7-8b58-c7a0af255d94 for instance 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf on hv-cinder-80070 Dec 15 16:16:56.226811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-8cad00bc-8a47-4256-a885-f891c35aed97 req-befa651b-7922-4c39-9135-af06593ebb73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041443 Dec 15 16:16:56.229343 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 548/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:16:56.264472 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4de2a2126b2414896bcf84605ec5760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767457cee9584e02afc690428a89a898', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:56.272233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-c8629d38-8640-4b73-837b-5b305142f4e9 tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 200 len: 1427 microversion: 2.1 time: 0.114838 Dec 15 16:16:56.272834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 465/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:56 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:56.844518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:56.845202 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:56.851372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:56.851813 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:56.853161 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:56.853637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:56.989870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:56.997995 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:56.999485 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:57.000635 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-982b612e-61e7-4e83-a96d-7c2bcd00b37c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.160189 Dec 15 16:16:57.001190 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 549/1014] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:56 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:57.121951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:57.122589 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:57.128813 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:57.129255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:57.130067 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:57.130501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:57.259582 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:57.267074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-40189280-9189-4711-9aad-61da8471e37c tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.148735 Dec 15 16:16:57.267652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 466/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:57 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:57.290734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:57.291350 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] [instance: 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:57.297672 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:57.298125 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:57.298913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:57.299354 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:57.313110 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] HTTP exception thrown: Instance 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf could not be found. Dec 15 16:16:57.313742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] Returning 404 to user: Instance 23bbab0f-7ee0-4ef7-adc9-94502d92a5bf could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:16:57.314573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7c7ab21f-eca2-4baf-8a43-26f7392a79cd tempest-VolumesNegativeTest-1583526834 tempest-VolumesNegativeTest-1583526834-project] 10.222.0.36 "GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf" status: 404 len: 111 microversion: 2.1 time: 0.028075 Dec 15 16:16:57.315112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 550/1016] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:57 2021] GET /compute/v2.1/servers/23bbab0f-7ee0-4ef7-adc9-94502d92a5bf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:57.451918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-066066f0-2cca-4173-986c-584d32a992eb req-c7139610-1f2a-41d3-a048-d1f8fe3648e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "name": "network-vif-plugged", "status": "completed", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:57.453602 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:57.453602 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:16:57.464655 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-066066f0-2cca-4173-986c-584d32a992eb req-c7139610-1f2a-41d3-a048-d1f8fe3648e5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:57.465420 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-066066f0-2cca-4173-986c-584d32a992eb req-c7139610-1f2a-41d3-a048-d1f8fe3648e5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:57.477116 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-066066f0-2cca-4173-986c-584d32a992eb req-c7139610-1f2a-41d3-a048-d1f8fe3648e5 service nova] Creating event network-vif-plugged:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:16:57.482988 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-066066f0-2cca-4173-986c-584d32a992eb req-c7139610-1f2a-41d3-a048-d1f8fe3648e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037501 Dec 15 16:16:57.484170 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 467/1017] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:58.018549 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:58.019181 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:58.025022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:58.025289 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:58.026112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:58.026544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:58.163352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:58.175759 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:58.178677 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:58.181325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-080ad3a2-6945-49f7-a31c-ffd39989df18 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.165664 Dec 15 16:16:58.182917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 551/1018] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:58 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:58.284385 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:58.285081 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:58.292521 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:58.292990 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:58.293820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:58.294261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:58.427176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:58.434871 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ad8fbacb-75cc-4c32-b03a-771c0dab6dee tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.154310 Dec 15 16:16:58.435542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 468/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:58 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:59.206517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:59.207169 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:59.214486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.214945 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.215743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.216418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.392687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:59.404100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:59.406327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:59.407704 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-afa43031-db3b-4b62-a349-c0768ba12b69 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1732 microversion: 2.20 time: 0.205039 Dec 15 16:16:59.408762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 552/1020] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:16:59 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:16:59.451773 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:59.452389 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:59.459264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.459723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.460519 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.461048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.497690 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-4063cf6a-f057-402d-a59e-7054a542e635 req-2d96a22d-5130-4ff1-a8d2-24679c4949ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f10094-2d7d-44fa-9078-a104e2e6ef84", "name": "network-vif-plugged", "status": "completed", "tag": "ae641ced-6e64-46f2-ad18-9b3191eb38ed"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:59.500095 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:59.500095 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:16:59.507762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4063cf6a-f057-402d-a59e-7054a542e635 req-2d96a22d-5130-4ff1-a8d2-24679c4949ed service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.508215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4063cf6a-f057-402d-a59e-7054a542e635 req-2d96a22d-5130-4ff1-a8d2-24679c4949ed service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.520104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-4063cf6a-f057-402d-a59e-7054a542e635 req-2d96a22d-5130-4ff1-a8d2-24679c4949ed service nova] Creating event network-vif-plugged:ae641ced-6e64-46f2-ad18-9b3191eb38ed for instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 on hv-cinder-80070 Dec 15 16:16:59.525523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-4063cf6a-f057-402d-a59e-7054a542e635 req-2d96a22d-5130-4ff1-a8d2-24679c4949ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Dec 15 16:16:59.526389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 553/1021] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:16:59.617984 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:59.642950 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b87f6265-c1fb-4464-b76f-5d4d8fa40f43 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.194088 Dec 15 16:16:59.643640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 469/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:59 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:00.427370 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:00.428087 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:00.434694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:00.435134 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:00.435899 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:00.436326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:00.575395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:00.583058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:00.584544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:00.585713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6bf085d-9984-439b-99af-ebe907a2db61 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1719 microversion: 2.20 time: 0.162898 Dec 15 16:17:00.586266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 554/1023] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:00 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:17:00.660072 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:00.660733 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:00.667814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:00.668264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:00.669043 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:00.669503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:00.800816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:00.809629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-edba2196-8ad0-48ac-8490-44598b7bf643 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1363 microversion: 2.1 time: 0.153464 Dec 15 16:17:00.810396 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 470/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:00 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:01.830108 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:01.830883 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:01.837782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:01.838225 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:01.839041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:01.839475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:01.986444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:01.993813 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a3e9c07-4f29-48b2-88c6-904f25348c29 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1550 microversion: 2.1 time: 0.167462 Dec 15 16:17:01.994386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 555/1025] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:01 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:02.010423 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:02.011087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:02.017135 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:02.017620 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:02.018410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:02.018845 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:02.102529 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b288318e-32f0-4e0f-adf0-3f2f3198c2b9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096298 Dec 15 16:17:02.103274 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 471/1026] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Dec 15 16:17:02 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:03.354199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:03.355801 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:03.362875 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:03.363413 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:03.364821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:03.365487 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:03.391426 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-c606e360-5ce8-4112-ba63-951dd9dc2b38 req-b81f97c5-e089-41a0-a411-c60afabd358b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f10094-2d7d-44fa-9078-a104e2e6ef84", "tag": "ae641ced-6e64-46f2-ad18-9b3191eb38ed"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:03.393305 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:03.393305 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:17:03.403481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c606e360-5ce8-4112-ba63-951dd9dc2b38 req-b81f97c5-e089-41a0-a411-c60afabd358b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:03.404021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-c606e360-5ce8-4112-ba63-951dd9dc2b38 req-b81f97c5-e089-41a0-a411-c60afabd358b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:03.418163 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-c606e360-5ce8-4112-ba63-951dd9dc2b38 req-b81f97c5-e089-41a0-a411-c60afabd358b service nova] Creating event network-changed:ae641ced-6e64-46f2-ad18-9b3191eb38ed for instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 on hv-cinder-80070 Dec 15 16:17:03.423024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-c606e360-5ce8-4112-ba63-951dd9dc2b38 req-b81f97c5-e089-41a0-a411-c60afabd358b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035824 Dec 15 16:17:03.423906 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 472/1027] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:03.458694 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5fc2c6b9-2cd4-458e-96ea-45d164c19ca1 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.108414 Dec 15 16:17:03.464474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 556/1028] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:03 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:04.472699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:04.473808 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:04.486385 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:04.486833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:04.487643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:04.488090 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:04.551076 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ed14c8e2-1383-41c8-81b8-cabc0b84c0bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.083586 Dec 15 16:17:04.551900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 473/1029] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:04 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:05.563386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:05.565237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:05.571978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:05.572447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:05.573261 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:05.573731 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:05.635919 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3d871087-c82e-47f1-98ad-fcf29ebc98d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.077044 Dec 15 16:17:05.636555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 557/1030] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:05 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:06.647398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:06.653148 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:06.661197 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:06.662001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:06.662883 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:06.663663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:06.733126 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f118c13d-f2f2-4910-8cac-987f6f33bb4f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.089779 Dec 15 16:17:06.734458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 474/1031] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:06 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:07.745371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:07.746448 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:07.753951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:07.754388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:07.755384 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:07.755981 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:07.827388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-78b9dfe5-012a-4005-bb57-5db35425ef9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.086070 Dec 15 16:17:07.828007 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 558/1032] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:07 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:08.840214 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:08.841543 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:08.854850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:08.855307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:08.856124 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:08.856581 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:08.963366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-af08d424-a308-48e8-ac88-dde5276c64dc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.127872 Dec 15 16:17:08.965029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 475/1033] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:08 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:09.975970 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:09.978541 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:09.986372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:09.986734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:09.987518 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:09.988174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:10.088907 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4e93e163-4ac2-4111-b7df-9c47b97b4666 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.117069 Dec 15 16:17:10.090109 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 559/1034] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:09 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:11.100973 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:11.102153 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:11.113665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:11.114328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:11.115287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:11.115729 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:11.186144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9102696e-bd9b-424d-89f3-bfe3e3d5d574 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.089239 Dec 15 16:17:11.188483 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 476/1035] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:11 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:12.123663 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0cf30549-535f-43bc-a53e-f8f0ed9841e2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Action: 'create', calling method: .version_select at 0x7f88b8daaee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-668839965"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:12.137501 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-0cf30549-535f-43bc-a53e-f8f0ed9841e2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for project d37336bbfbab45f79ed53d56efe617c4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:17:12.141219 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-0cf30549-535f-43bc-a53e-f8f0ed9841e2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for user 0c89b280c0864631a57aab8564633443 and project d37336bbfbab45f79ed53d56efe617c4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:17:12.199850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:12.200980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:12.208255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:12.208864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:12.209814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:12.210338 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:12.304411 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-6490c0bd-fbfb-4b23-b031-3fc71a8545c8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14 microversion: 2.1 time: 0.109352 Dec 15 16:17:12.305508 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 477/1036] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:12 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:17:12.524346 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-0cf30549-535f-43bc-a53e-f8f0ed9841e2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for project d37336bbfbab45f79ed53d56efe617c4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:17:12.539016 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-0cf30549-535f-43bc-a53e-f8f0ed9841e2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for user 0c89b280c0864631a57aab8564633443 and project d37336bbfbab45f79ed53d56efe617c4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:17:12.556588 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0cf30549-535f-43bc-a53e-f8f0ed9841e2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.614274 Dec 15 16:17:12.557501 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 560/1037] 10.222.0.36 () {60 vars in 1157 bytes} [Wed Dec 15 16:17:11 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:13.316796 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:13.317825 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:13.325481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:13.325929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:13.326711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:13.327140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:13.403482 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a22d04a0-800f-4a07-86a8-55dc89f904bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 4298 microversion: 2.1 time: 0.090616 Dec 15 16:17:13.404153 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 478/1038] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:13 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 4298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:14.414569 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:14.415744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:14.422475 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:14.422928 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:14.423712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:14.424143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:14.504209 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6552c7a1-c243-43b3-8c7b-054c9ae2b023 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 14250 microversion: 2.1 time: 0.093382 Dec 15 16:17:14.504858 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 561/1039] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:14 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 14250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:15.516150 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:15.517151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:15.524263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:15.524771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:15.525817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:15.526250 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:15.617669 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cf798654-54aa-43f8-b9c5-b11be3935760 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 17931 microversion: 2.1 time: 0.105287 Dec 15 16:17:15.618341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 479/1040] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:15 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 17931 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:16.630146 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:16.631142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:16.638260 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:16.638705 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:16.639481 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:16.639916 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:16.718307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b6ce17f6-272d-4956-8186-ae0172f4f77e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 19133 microversion: 2.1 time: 0.091969 Dec 15 16:17:16.718988 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 562/1041] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:16 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 19133 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:17.730850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:17.731764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:17.738664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:17.739108 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:17.739912 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:17.740339 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:17.818821 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ffd0045c-7054-4926-b71b-ebe0fad76810 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 20991 microversion: 2.1 time: 0.092430 Dec 15 16:17:17.819468 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 480/1042] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:17 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 20991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:18.831197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:18.832230 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:18.839827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:18.840327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:18.841064 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:18.841526 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:18.935786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dac93fd0-0402-4584-8de6-15676aba3699 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 22890 microversion: 2.1 time: 0.107975 Dec 15 16:17:18.936898 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 563/1043] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:18 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 22890 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:19.948731 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:19.949780 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:19.956851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:19.957325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:19.958139 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:19.958571 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:20.039380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8ad8a0d3-7b4b-4388-a695-cbe8b4cb7faf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 23797 microversion: 2.1 time: 0.094925 Dec 15 16:17:20.041993 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 481/1044] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:19 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 23797 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:21.160426 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:21.161463 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:21.169081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:21.169572 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:21.170421 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:21.170877 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:21.247842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-630ff557-7667-4ee2-8364-e46213735b8f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 24951 microversion: 2.1 time: 0.199857 Dec 15 16:17:21.248470 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 564/1045] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:21 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 24951 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:22.259626 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:22.260635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:22.267389 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:22.267829 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:22.268589 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:22.269013 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:22.348684 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2be71a41-57f4-459e-87e1-6287c4e26e9f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 26134 microversion: 2.1 time: 0.092966 Dec 15 16:17:22.349343 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 482/1046] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:22 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 26134 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:23.360517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:23.361539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:23.368208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:23.368787 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:23.369669 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:23.370105 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:23.455591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-221f295b-a20c-4e69-be4f-36e706990154 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 27074 microversion: 2.1 time: 0.098845 Dec 15 16:17:23.456474 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 565/1047] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:23 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 27074 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:24.468032 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:24.469048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:24.475770 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:24.476210 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:24.476978 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:24.477419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:24.565121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-55ca2643-5d22-4954-ae84-bb614c5b569f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 27651 microversion: 2.1 time: 0.100887 Dec 15 16:17:24.565820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 483/1048] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:24 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 27651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:25.577814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:25.578811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:25.586342 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:25.586788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:25.587661 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:25.588094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:25.674631 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c651c0f6-9d9a-4b78-a766-10c2f620b61f tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28000 microversion: 2.1 time: 0.100647 Dec 15 16:17:25.675275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 566/1049] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:25 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28000 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:26.686609 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:26.687600 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:26.694457 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:26.694902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:26.695674 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:26.696105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:26.780334 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-949831c5-74fc-430c-8439-66569d628273 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28256 microversion: 2.1 time: 0.097536 Dec 15 16:17:26.781147 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 484/1050] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:26 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28256 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:27.792379 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:27.793289 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:27.800066 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:27.800505 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:27.801273 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:27.801733 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:27.872561 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c133eb7-96cd-4f1d-8964-fc3125c92561 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28256 microversion: 2.1 time: 0.085001 Dec 15 16:17:27.873191 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 567/1051] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:27 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28256 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:28.884565 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:28.885596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:28.892382 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:28.892865 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:28.893718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:28.894149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:28.979426 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8849db77-62dd-425f-a33b-e48aca5f27a7 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28381 microversion: 2.1 time: 0.098753 Dec 15 16:17:28.980319 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 485/1052] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:28 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28381 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:29.990942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:29.991864 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:29.999601 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:30.000065 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:30.000844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:30.001281 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:30.082440 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1fe6842a-03ea-467a-b25d-7bc13dfced4a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28545 microversion: 2.1 time: 0.095526 Dec 15 16:17:30.083081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 568/1053] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:29 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28545 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:31.095478 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:31.096481 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:31.104479 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:31.104936 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:31.105850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:31.106292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:31.195701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-24a59d0a-1550-4dde-9cdf-66a1f75209ac tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28713 microversion: 2.1 time: 0.104299 Dec 15 16:17:31.196339 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 486/1054] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:31 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28713 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:31.872790 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1379437914", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-668839965", "security_groups": [{"name": "tempest-secgroup-smoke-1366060423"}], "block_device_mapping_v2": [{"uuid": "12f1f2d4-dd5e-4a42-8154-7fbcd0d600d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6bf17fcc-7520-487a-8b2c-b8aaa08a20f8"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:32.018587 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] validate_networks() for [('6bf17fcc-7520-487a-8b2c-b8aaa08a20f8', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:17:32.208242 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:32.209262 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:32.217368 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:32.217939 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:32.219180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:32.219180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:32.294307 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-05abcb00-9fe8-4d2a-bf71-c0d544f7f39e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28713 microversion: 2.1 time: 0.089872 Dec 15 16:17:32.298327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 487/1055] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:32 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28713 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:32.489735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:17:32.490199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:17:32.490670 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:17:32.491079 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:17:32.491500 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:17:32.501486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:32.501967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:32.502784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:32.503220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:32.520144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for project d37336bbfbab45f79ed53d56efe617c4. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:17:32.524445 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for user 0c89b280c0864631a57aab8564633443 and project d37336bbfbab45f79ed53d56efe617c4. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:17:32.580444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:17:32.582695 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12f1f2d4-dd5e-4a42-8154-7fbcd0d600d7',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:17:32.706358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-73720013-96ee-4ce2-a65c-3a3671e1bee4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837777 Dec 15 16:17:32.707168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 569/1056] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:17:31 2021] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:17:32.717559 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4d70d444-4533-421c-ad86-3d0c1afb420f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:32.718264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4d70d444-4533-421c-ad86-3d0c1afb420f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:32.775769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4d70d444-4533-421c-ad86-3d0c1afb420f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:32.782696 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4d70d444-4533-421c-ad86-3d0c1afb420f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1094 microversion: 2.1 time: 0.069187 Dec 15 16:17:32.783264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 488/1057] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:32 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:33.307311 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:33.308534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:33.315422 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.315840 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:33.316621 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.317057 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:33.380523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2c301aa2-03c8-4343-b51a-b76fe14a1a66 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28713 microversion: 2.1 time: 0.078137 Dec 15 16:17:33.381150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 570/1058] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:33 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28713 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:33.799828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:33.800519 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:33.807392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.807911 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:33.808794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.809286 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:33.879172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:33.887402 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-573ede70-ffd7-498f-9872-480ef852618f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1210 microversion: 2.1 time: 0.091317 Dec 15 16:17:33.888077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 489/1059] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:33 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:34.394327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:34.396098 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:34.404248 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:34.404656 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:34.405684 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:34.406011 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:34.477628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32a253be-ad21-4a63-840a-6726d4d45d57 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 28713 microversion: 2.1 time: 0.088799 Dec 15 16:17:34.478312 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 571/1060] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:34 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 28713 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:34.905635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:34.906301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:34.914137 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:34.915055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:34.915879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:34.916319 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:35.152991 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:35.161536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4f8db03c-0ab4-4c0b-b8bc-09badbb5be56 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.261179 Dec 15 16:17:35.170874 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 490/1061] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:34 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:35.177208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1b086df7-a68d-44be-8393-0e0aec3d304f req-6f182bf3-88a3-4180-b937-ce680cfd098a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a17033c-80a1-4a18-add4-7d228b7ea5e9", "tag": "1e90e512-10b9-4ab9-885d-f0050132cce7"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:35.179067 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:35.179067 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:17:35.187340 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1b086df7-a68d-44be-8393-0e0aec3d304f req-6f182bf3-88a3-4180-b937-ce680cfd098a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:35.187810 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1b086df7-a68d-44be-8393-0e0aec3d304f req-6f182bf3-88a3-4180-b937-ce680cfd098a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:35.199940 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1b086df7-a68d-44be-8393-0e0aec3d304f req-6f182bf3-88a3-4180-b937-ce680cfd098a service nova] Creating event network-changed:1e90e512-10b9-4ab9-885d-f0050132cce7 for instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 on hv-cinder-80070 Dec 15 16:17:35.205058 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1b086df7-a68d-44be-8393-0e0aec3d304f req-6f182bf3-88a3-4180-b937-ce680cfd098a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031625 Dec 15 16:17:35.205973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 572/1062] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:35.489085 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:35.490015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:35.496764 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:35.497208 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:35.498028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:35.498464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:35.580362 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-0d269659-bcb3-458a-ab71-11d1fff3aa36 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 29701 microversion: 2.1 time: 0.094762 Dec 15 16:17:35.584292 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 491/1063] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:35 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 29701 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:36.179931 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:36.180573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:36.186634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.187080 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.187851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.188277 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.318083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:36.326124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-970fbb9d-e3e8-4c99-a9ca-6b4811c173de tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.150650 Dec 15 16:17:36.326686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 573/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:36 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:36.591353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:36.592375 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:36.599155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.599601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.600374 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.600807 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.687923 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-490347dc-69e9-4194-92d4-7dba96fa6398 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 31580 microversion: 2.1 time: 0.100383 Dec 15 16:17:36.688559 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 492/1065] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:36 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 31580 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:37.344213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:37.344823 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:37.351067 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:37.351511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:37.352282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:37.352709 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:37.484410 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:37.491534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-73b8ca53-2971-4c13-b670-6f340e4e7d18 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.151063 Dec 15 16:17:37.492093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 574/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:37 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:37.700100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:37.701008 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:37.707824 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:37.708267 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:37.709037 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:37.709493 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:37.795577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-3e93ac3e-b533-4b9e-998b-232aaf55b0d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 32949 microversion: 2.1 time: 0.099528 Dec 15 16:17:37.796198 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 493/1067] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:37 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 32949 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:38.507853 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:38.508444 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:38.514692 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:38.515129 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:38.515892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:38.516323 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:38.645818 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:38.653783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7b802a53-1b67-4479-a637-f6b120a63572 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.149527 Dec 15 16:17:38.654339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 575/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:38 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:38.807719 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:38.808655 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:38.815578 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:38.816027 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:38.816826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:38.817261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:38.893801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a3353c08-1416-407f-93e4-1073fb53c2a4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 33671 microversion: 2.1 time: 0.089946 Dec 15 16:17:38.894438 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 494/1069] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:38 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 33671 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:39.384222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:39.386106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:39.392292 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.392743 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.393550 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.393984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.424762 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f7152d25-3e33-4e1f-8a10-76a77f89cc2c tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044353 Dec 15 16:17:39.425305 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 576/1070] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Dec 15 16:17:39 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:39.481052 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:39.481663 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:39.488362 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.488805 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.489613 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.490048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.514627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:17:39.587282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b8750cc0-1854-4dff-b2ca-cf43371baa03 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 204 len: 0 microversion: 2.20 time: 0.109798 Dec 15 16:17:39.588689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 495/1071] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 16:17:39 2021] DELETE /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:17:39.596918 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:39.597551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:39.603300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.603752 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.604667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.605243 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.671096 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:39.671785 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:39.677932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.678376 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.679162 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.679592 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.737536 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:39.745856 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:39.747377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:39.748529 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-934f8a0c-2cbe-47da-8ff9-229dd1b96706 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.155305 Dec 15 16:17:39.749077 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 577/1072] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:39 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:17:39.814828 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:39.823489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1e4e40ee-1553-424e-88dc-fd0b053e35f3 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.156238 Dec 15 16:17:39.824059 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 496/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:39 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:17:39.905429 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:39.906273 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:39.912341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.912784 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.913610 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:39.914036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:39.994982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fd81da47-0529-4f6b-8c36-64b5932b3f28 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 34651 microversion: 2.1 time: 0.093155 Dec 15 16:17:39.995626 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 578/1074] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:39 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 34651 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:40.771745 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:40.772344 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:40.779322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:40.779762 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:40.780525 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:40.780949 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:40.841094 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:40.841819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:40.848600 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:40.849051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:40.849859 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:40.850298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:40.912009 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:40.920925 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:40.923363 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:40.925510 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-78cb6b53-1b3d-4d33-8488-f305a0b2e469 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1725 microversion: 2.20 time: 0.157058 Dec 15 16:17:40.926558 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 497/1075] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:40 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:17:40.985544 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:40.992825 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-11096b2c-51a1-4ad7-a879-261a845ca275 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.156390 Dec 15 16:17:40.993411 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 579/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:40 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:17:41.006695 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:41.007615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:41.013976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:41.014425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:41.015203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:41.015640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:41.088380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-56a0f863-c51a-4b43-8d42-d5b6674ca08e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 35604 microversion: 2.1 time: 0.084601 Dec 15 16:17:41.089028 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 498/1077] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:41 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 35604 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:41.943950 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:41.944555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:41.951729 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:41.952187 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:41.953093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:41.953640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:42.014980 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:42.015678 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:42.030120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:42.030943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:42.032018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:42.032549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:42.081241 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:42.094023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:42.096148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b01ba54246a4e8482417367b6329c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293903670af4a238fe13d805fcd9d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:42.097755 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-48e1d319-3d2f-4c4a-bea9-ad3c0417924e tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 200 len: 1657 microversion: 2.20 time: 0.157409 Dec 15 16:17:42.098546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 580/1078] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:41 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:17:42.108382 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-10f494eb-7887-422c-8a67-78e28fc2b950 req-f68aec5f-af4e-4c1d-a128-772f46e8f4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc64764-e851-4cab-a602-b8669ed3aebe", "name": "network-vif-deleted", "tag": "d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:42.113811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:42.113811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:17:42.132830 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-10f494eb-7887-422c-8a67-78e28fc2b950 req-f68aec5f-af4e-4c1d-a128-772f46e8f4ad service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:42.133377 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-10f494eb-7887-422c-8a67-78e28fc2b950 req-f68aec5f-af4e-4c1d-a128-772f46e8f4ad service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:42.145973 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-10f494eb-7887-422c-8a67-78e28fc2b950 req-f68aec5f-af4e-4c1d-a128-772f46e8f4ad service nova] Creating event network-vif-deleted:d1cf42c5-3f15-47e7-8f7a-ae7385cf6b76 for instance 6cc64764-e851-4cab-a602-b8669ed3aebe on hv-cinder-80070 Dec 15 16:17:42.152216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-10f494eb-7887-422c-8a67-78e28fc2b950 req-f68aec5f-af4e-4c1d-a128-772f46e8f4ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051934 Dec 15 16:17:42.154338 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 581/1079] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:42.161266 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:42.163551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:42.171068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:42.171797 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:42.173144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:42.173789 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:42.220467 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:42.231492 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-90e25553-1d04-4f57-9d12-6b4600f431c2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.220693 Dec 15 16:17:42.232179 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 499/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:42 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:42.271689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6f5e4851-03d6-4e7d-b27d-5f9ec5b09153 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 36976 microversion: 2.1 time: 0.115493 Dec 15 16:17:42.273541 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 582/1081] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:42 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 36976 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:43.115883 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:43.116482 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:43.122941 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:43.123421 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:43.124204 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:43.124628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:43.138811 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] HTTP exception thrown: Instance 6cc64764-e851-4cab-a602-b8669ed3aebe could not be found. Dec 15 16:17:43.139394 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Returning 404 to user: Instance 6cc64764-e851-4cab-a602-b8669ed3aebe could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:43.140215 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-10c85e6e-6e03-4a72-9f51-0a1b06fb4aed tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 404 len: 111 microversion: 2.20 time: 0.028078 Dec 15 16:17:43.140756 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 500/1082] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:43 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:17:43.149586 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb746370-5926-4857-86b6-9394308a7780 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '.version_select at 0x7f88abf4c0d0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:43.169287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eb746370-5926-4857-86b6-9394308a7780 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073304974" status: 204 len: 0 microversion: 2.20 time: 0.023735 Dec 15 16:17:43.169897 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 583/1083] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Dec 15 16:17:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073304974 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 16:17:43.248583 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:43.249199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:43.255409 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:43.255861 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:43.256643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:43.257080 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:43.283951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:43.285325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:43.294491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:43.295044 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:43.295903 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:43.296435 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:43.381842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9e74aac3-039f-4c69-aae0-3e6c5827145d tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 38238 microversion: 2.1 time: 0.101246 Dec 15 16:17:43.383777 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 584/1084] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:43 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 38238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:43.415130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:43.427771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2d2cbf4d-fcba-4e0d-89de-00d302fed4c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.183446 Dec 15 16:17:43.428501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 501/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:43 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:44.396105 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:44.397135 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:44.404371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:44.404820 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:44.405627 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:44.406061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:44.444664 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:44.445994 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:44.452958 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:44.453410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:44.454203 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:44.454653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:44.475091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-313863fb-2316-49ce-abb1-ed76275b61ff tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 38238 microversion: 2.1 time: 0.082663 Dec 15 16:17:44.475708 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 585/1086] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:44 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 38238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:44.589011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:44.596191 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1fdd8d13-f3e2-4800-82d5-d2069b3d52b0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.155165 Dec 15 16:17:44.596765 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 502/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:44 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:17:44.970307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:44.971212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:44.977785 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:44.978848 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:44.979637 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:44.980061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:44.993764 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] HTTP exception thrown: Instance 6cc64764-e851-4cab-a602-b8669ed3aebe could not be found. Dec 15 16:17:44.994693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Returning 404 to user: Instance 6cc64764-e851-4cab-a602-b8669ed3aebe could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:44.995497 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2ca3192e-019c-4727-a35d-36e2d2d69b30 tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 404 len: 111 microversion: 2.20 time: 0.029376 Dec 15 16:17:44.996019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 586/1088] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 16:17:44 2021] DELETE /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:17:45.003686 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:45.004293 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 6cc64764-e851-4cab-a602-b8669ed3aebe] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:45.010240 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.010689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.011464 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.011900 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.024602 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] HTTP exception thrown: Instance 6cc64764-e851-4cab-a602-b8669ed3aebe could not be found. Dec 15 16:17:45.025753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Returning 404 to user: Instance 6cc64764-e851-4cab-a602-b8669ed3aebe could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:45.026718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d07ce0c9-6fe4-49f5-8ab1-a5e1b25e44df tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe" status: 404 len: 111 microversion: 2.20 time: 0.026650 Dec 15 16:17:45.027236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 503/1089] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:44 2021] GET /compute/v2.1/servers/6cc64764-e851-4cab-a602-b8669ed3aebe => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 16:17:45.487742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:45.488665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:45.495089 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-bf544644-cd64-457c-96da-ba9d448b2187 req-b70cfef2-5ff4-498b-83ea-0d75caf7a616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a17033c-80a1-4a18-add4-7d228b7ea5e9", "name": "network-vif-plugged", "status": "completed", "tag": "1e90e512-10b9-4ab9-885d-f0050132cce7"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:45.496307 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.496767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.497263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:45.497263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:17:45.497603 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.498012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.506287 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-bf544644-cd64-457c-96da-ba9d448b2187 req-b70cfef2-5ff4-498b-83ea-0d75caf7a616 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.506834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-bf544644-cd64-457c-96da-ba9d448b2187 req-b70cfef2-5ff4-498b-83ea-0d75caf7a616 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.518200 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-bf544644-cd64-457c-96da-ba9d448b2187 req-b70cfef2-5ff4-498b-83ea-0d75caf7a616 service nova] Creating event network-vif-plugged:1e90e512-10b9-4ab9-885d-f0050132cce7 for instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 on hv-cinder-80070 Dec 15 16:17:45.523263 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-bf544644-cd64-457c-96da-ba9d448b2187 req-b70cfef2-5ff4-498b-83ea-0d75caf7a616 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Dec 15 16:17:45.524200 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 504/1090] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:45.573012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-917fd599-d69f-4345-bcaa-bd123b38f8c6 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 38238 microversion: 2.1 time: 0.088924 Dec 15 16:17:45.577348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 587/1091] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:45 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 38238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:17:45.613701 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:45.614317 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:45.621133 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.621627 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.622404 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:45.622833 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:45.785563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:45.793732 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fd999c74-8473-46be-a30a-a6c6d13bd1ae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.184081 Dec 15 16:17:45.794304 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 505/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:45 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:46.152742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:46.153319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:46.160118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.160571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.161344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.161814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.175765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] HTTP exception thrown: Instance 58bcd354-b76f-4f2c-8062-f7888f226c7c could not be found. Dec 15 16:17:46.176344 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Returning 404 to user: Instance 58bcd354-b76f-4f2c-8062-f7888f226c7c could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:46.177155 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-375655c9-4d5b-4011-a92b-08d7d7a38d7a tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 404 len: 111 microversion: 2.20 time: 0.029299 Dec 15 16:17:46.177702 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 588/1093] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Dec 15 16:17:46 2021] DELETE /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:17:46.185266 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:46.185899 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] [instance: 58bcd354-b76f-4f2c-8062-f7888f226c7c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:46.191531 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.191973 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.192733 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.193154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.206581 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] HTTP exception thrown: Instance 58bcd354-b76f-4f2c-8062-f7888f226c7c could not be found. Dec 15 16:17:46.207160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] Returning 404 to user: Instance 58bcd354-b76f-4f2c-8062-f7888f226c7c could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:46.207971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-5d785bf0-8c53-481a-aa4a-65054104e2bf tempest-AttachVolumeShelveTestJSON-1693262765 tempest-AttachVolumeShelveTestJSON-1693262765-project] 10.222.0.36 "GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c" status: 404 len: 111 microversion: 2.20 time: 0.026355 Dec 15 16:17:46.208501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 506/1094] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Dec 15 16:17:46 2021] GET /compute/v2.1/servers/58bcd354-b76f-4f2c-8062-f7888f226c7c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:17:46.584725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:46.585664 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:46.592159 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.592609 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.593381 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.593833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.658157 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bf8172c8-b23d-4e05-9eb9-b99aa2d8de90 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 38238 microversion: 2.1 time: 0.076922 Dec 15 16:17:46.662347 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 589/1095] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:46 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 38238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:46.811873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:46.812480 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:46.818939 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.819425 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:46.820344 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:46.820785 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:47.232648 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:47.240056 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-abd670b1-54f0-4749-b680-eed5fa0a8aa2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1266 microversion: 2.1 time: 0.432630 Dec 15 16:17:47.240629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 507/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:46 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1266 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:47.671606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:47.672767 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:47.679846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:47.680296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:47.681076 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:47.682290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:47.764543 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4910e326-507c-4ef0-9b79-cd998370b9e8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action" status: 200 len: 38369 microversion: 2.1 time: 0.096409 Dec 15 16:17:47.765327 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 590/1097] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Dec 15 16:17:47 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/action => generated 38369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:17:47.776076 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:47.777080 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:47.784146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:47.784595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:47.785380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:47.785827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:47.810428 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7a5d21da-510f-40d8-bf9e-608677ec57bf tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/ips" status: 200 len: 147 microversion: 2.1 time: 0.038866 Dec 15 16:17:47.811000 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 508/1098] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 16:17:47 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:48.257571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:48.258269 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:48.265654 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:48.266099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:48.266884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:48.267311 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:48.408808 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:48.417846 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-36888237-b07d-4c52-92dc-dbe455ae1db4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1453 microversion: 2.1 time: 0.164031 Dec 15 16:17:48.429277 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 591/1099] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:48 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:48.437285 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:48.440001 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:48.448652 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:48.449271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:48.450424 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:48.450960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:48.662826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:48.671082 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8ac29fdc-8623-44a0-b912-22c201708772 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1453 microversion: 2.1 time: 0.240212 Dec 15 16:17:48.671563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 509/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:48 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:17:49.142942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:49.144036 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:49.152633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:49.153104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:49.153947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:49.154797 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:49.441372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-29f80b5a-40c5-44e6-8fb6-5ce889cdc568 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309851 Dec 15 16:17:49.442666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 592/1101] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:17:49 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:50.784373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1ecb29f0-695f-4567-bb83-9386a9e48ba0 req-7cb25263-a7a7-4aef-b760-9fab0d55c831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a17033c-80a1-4a18-add4-7d228b7ea5e9", "tag": "1e90e512-10b9-4ab9-885d-f0050132cce7"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:50.786207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:50.786207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:17:50.793949 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1ecb29f0-695f-4567-bb83-9386a9e48ba0 req-7cb25263-a7a7-4aef-b760-9fab0d55c831 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:50.794533 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1ecb29f0-695f-4567-bb83-9386a9e48ba0 req-7cb25263-a7a7-4aef-b760-9fab0d55c831 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:50.805651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1ecb29f0-695f-4567-bb83-9386a9e48ba0 req-7cb25263-a7a7-4aef-b760-9fab0d55c831 service nova] Creating event network-changed:1e90e512-10b9-4ab9-885d-f0050132cce7 for instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 on hv-cinder-80070 Dec 15 16:17:50.811187 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1ecb29f0-695f-4567-bb83-9386a9e48ba0 req-7cb25263-a7a7-4aef-b760-9fab0d55c831 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156321 Dec 15 16:17:50.812164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 510/1102] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:51.267044 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-76aa5797-95f4-4dd1-952d-251617ccfbfe tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Action: 'create', calling method: .version_select at 0x7f88b805f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1060260385"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:51.563461 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-76aa5797-95f4-4dd1-952d-251617ccfbfe tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.419166 Dec 15 16:17:51.564271 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 593/1103] 10.222.0.36 () {60 vars in 1154 bytes} [Wed Dec 15 16:17:51 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 16:17:51.575926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-21af2a4f-e756-4cbf-816b-9a68925dc66e tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b81c64c0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:51.640060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-21af2a4f-e756-4cbf-816b-9a68925dc66e tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 200 len: 345 microversion: 2.1 time: 0.068247 Dec 15 16:17:51.640661 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 511/1104] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:17:51 2021] GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:52.652978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ab257b0-360b-46dc-9fb0-f20cbc5a3b38 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8be6c10>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:52.701216 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ab257b0-360b-46dc-9fb0-f20cbc5a3b38 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 200 len: 346 microversion: 2.1 time: 0.052990 Dec 15 16:17:52.702000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 594/1105] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:17:52 2021] GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:52.713871 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d3ef77e2-4d65-425c-83e4-c143b2102e2c tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Action: 'create', calling method: .version_select at 0x7f88b80970d0>, body: {"snapshot": {"volume_id": "fcf7361b-00b5-4e1c-b922-9ac3f861d359", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-995392954"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:52.851021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d3ef77e2-4d65-425c-83e4-c143b2102e2c tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.141999 Dec 15 16:17:52.851893 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 512/1106] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Dec 15 16:17:52 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:52.862917 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-93b33f1e-2bb0-4996-8d87-8dcae485a09c tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8d22280>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:52.896583 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-93b33f1e-2bb0-4996-8d87-8dcae485a09c tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 286 microversion: 2.1 time: 0.038023 Dec 15 16:17:52.897378 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 595/1107] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:52 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:52.908566 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-801d65f0-42b7-440c-a2de-6ae2b081fae1 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8079ee0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:52.939236 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-801d65f0-42b7-440c-a2de-6ae2b081fae1 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034409 Dec 15 16:17:52.939801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 513/1108] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Dec 15 16:17:52 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:52.950061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9ca9ca75-0e96-4a73-9f00-91e2f8a7fd93 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8117160>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:52.978177 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9ca9ca75-0e96-4a73-9f00-91e2f8a7fd93 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 286 microversion: 2.1 time: 0.032293 Dec 15 16:17:52.978730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 596/1109] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:52 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:53.990154 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1912d7ad-295d-4bb0-85bf-bc42da5b8b1e tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8079280>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:54.022725 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1912d7ad-295d-4bb0-85bf-bc42da5b8b1e tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 286 microversion: 2.1 time: 0.036526 Dec 15 16:17:54.023290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 514/1110] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:53 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:55.035030 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b59f9fd3-30fe-499a-ba3a-fef6e28e1725 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8268820>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:55.065116 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b59f9fd3-30fe-499a-ba3a-fef6e28e1725 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 286 microversion: 2.1 time: 0.034192 Dec 15 16:17:55.065688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 597/1111] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:55 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:56.076826 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-09bd5125-4de0-4089-97e8-d73644681869 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b81c6820>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:56.104677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-09bd5125-4de0-4089-97e8-d73644681869 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 286 microversion: 2.1 time: 0.032496 Dec 15 16:17:56.105224 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 515/1112] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:56 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:56.961416 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:56.962511 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:56.969476 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:56.969956 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:56.970736 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:56.971168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:56.999423 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f3d27c1b-2261-4c52-bf7f-435ea94dbecc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Dec 15 16:17:56.999996 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 598/1113] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:17:56 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:57.009549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:57.010202 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:57.016839 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:57.017227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:57.018017 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:57.018445 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:57.046842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-4ad4a3b8-24b4-45cf-ba06-854d5d47da84 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f" status: 200 len: 194 microversion: 2.1 time: 0.041098 Dec 15 16:17:57.047423 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 516/1114] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Dec 15 16:17:57 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:57.115749 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b697f90c-5ff5-4331-9653-ddb2cf3b96cf tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8181e50>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:57.143667 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b697f90c-5ff5-4331-9653-ddb2cf3b96cf tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 287 microversion: 2.1 time: 0.031502 Dec 15 16:17:57.144231 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 599/1115] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:57 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:57.154961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-75f950e2-e61f-4374-be1b-5c76c5ff04d3 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b80978b0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:57.210247 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-75f950e2-e61f-4374-be1b-5c76c5ff04d3 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 202 len: 0 microversion: 2.1 time: 0.059794 Dec 15 16:17:57.210842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 517/1116] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Dec 15 16:17:57 2021] DELETE /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:17:57.219427 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3316cd98-163a-40a2-9917-6116ec8a0601 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8268280>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:57.249144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3316cd98-163a-40a2-9917-6116ec8a0601 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 200 len: 286 microversion: 2.1 time: 0.033262 Dec 15 16:17:57.249744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 600/1117] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:57 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:58.261176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-71261780-c5b2-4424-8959-69ebb5d9a7cf tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b80638b0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:58.283854 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-71261780-c5b2-4424-8959-69ebb5d9a7cf tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] HTTP exception thrown: Snapshot e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 could not be found. Dec 15 16:17:58.284922 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-71261780-c5b2-4424-8959-69ebb5d9a7cf tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Returning 404 to user: Snapshot e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:58.285793 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-71261780-c5b2-4424-8959-69ebb5d9a7cf tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74" status: 404 len: 111 microversion: 2.1 time: 0.029061 Dec 15 16:17:58.286311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 518/1118] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Dec 15 16:17:58 2021] GET /compute/v2.1/os-snapshots/e5797ed3-b950-4cd3-aa5b-e85ec6c94e74 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:17:58.295314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cdb3341b-8805-46e8-8aad-ad2e882dd819 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8149550>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:58.350384 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61da75af-c0f2-4ca6-b379-f850a5d07552"}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:58.351487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:58.356816 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cdb3341b-8805-46e8-8aad-ad2e882dd819 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 202 len: 0 microversion: 2.1 time: 0.066000 Dec 15 16:17:58.357814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 601/1119] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 16:17:58 2021] DELETE /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:17:58.358789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:58.359317 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:58.360226 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:58.360715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:58.365820 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-93294de5-f1a6-48e5-8f83-797aa1a4379a tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8117310>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:58.413966 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-93294de5-f1a6-48e5-8f83-797aa1a4379a tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 200 len: 345 microversion: 2.1 time: 0.052005 Dec 15 16:17:58.414681 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 602/1120] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:17:58 2021] GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:58.593335 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8272dc32-7633-44ea-b0a8-20aef19ebc5a tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246921 Dec 15 16:17:58.593979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 519/1121] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:17:58 2021] POST /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:17:59.427298 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6b13a1e6-cfc7-407e-a3a5-ced599cfaf4b tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88abf9e700>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:59.454362 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-6b13a1e6-cfc7-407e-a3a5-ced599cfaf4b tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] HTTP exception thrown: Volume fcf7361b-00b5-4e1c-b922-9ac3f861d359 could not be found. Dec 15 16:17:59.454967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6b13a1e6-cfc7-407e-a3a5-ced599cfaf4b tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Returning 404 to user: Volume fcf7361b-00b5-4e1c-b922-9ac3f861d359 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:59.455912 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6b13a1e6-cfc7-407e-a3a5-ced599cfaf4b tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 404 len: 109 microversion: 2.1 time: 0.032641 Dec 15 16:17:59.456466 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 603/1122] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:17:59 2021] GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:17:59.466402 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-94ac9d1a-1959-486d-bd2b-0cb76561eb09 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8079a60>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:59.492700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-94ac9d1a-1959-486d-bd2b-0cb76561eb09 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] HTTP exception thrown: Volume fcf7361b-00b5-4e1c-b922-9ac3f861d359 could not be found. Dec 15 16:17:59.493326 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-94ac9d1a-1959-486d-bd2b-0cb76561eb09 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Returning 404 to user: Volume fcf7361b-00b5-4e1c-b922-9ac3f861d359 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:59.495077 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-94ac9d1a-1959-486d-bd2b-0cb76561eb09 tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 404 len: 109 microversion: 2.1 time: 0.032310 Dec 15 16:17:59.495634 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 520/1123] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 16:17:59 2021] DELETE /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:17:59.503821 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-637ffac2-4591-45a2-a69c-5255dd222efe tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Calling method '.version_select at 0x7f88b8c7adc0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:59.530174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-637ffac2-4591-45a2-a69c-5255dd222efe tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] HTTP exception thrown: Volume fcf7361b-00b5-4e1c-b922-9ac3f861d359 could not be found. Dec 15 16:17:59.530771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-637ffac2-4591-45a2-a69c-5255dd222efe tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] Returning 404 to user: Volume fcf7361b-00b5-4e1c-b922-9ac3f861d359 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:59.531799 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-637ffac2-4591-45a2-a69c-5255dd222efe tempest-VolumesSnapshotsTestJSON-1750711001 tempest-VolumesSnapshotsTestJSON-1750711001-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359" status: 404 len: 109 microversion: 2.1 time: 0.032164 Dec 15 16:17:59.532335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 604/1124] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:17:59 2021] GET /compute/v2.1/os-volumes/fcf7361b-00b5-4e1c-b922-9ac3f861d359 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:00.596049 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:00.596653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:00.598164 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-fcf8d858-ec0e-4597-99d7-7834032d06f5 req-150dd05e-fd22-4c21-a8b8-0987ab7fac07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:00.599652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:00.599652 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:18:00.608427 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:00.608879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:00.609806 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:00.610341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:00.617882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-fcf8d858-ec0e-4597-99d7-7834032d06f5 req-150dd05e-fd22-4c21-a8b8-0987ab7fac07 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:00.618320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-fcf8d858-ec0e-4597-99d7-7834032d06f5 req-150dd05e-fd22-4c21-a8b8-0987ab7fac07 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:00.629640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-fcf8d858-ec0e-4597-99d7-7834032d06f5 req-150dd05e-fd22-4c21-a8b8-0987ab7fac07 service nova] Creating event network-changed:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:18:00.635004 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-fcf8d858-ec0e-4597-99d7-7834032d06f5 req-150dd05e-fd22-4c21-a8b8-0987ab7fac07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040593 Dec 15 16:18:00.636109 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 605/1125] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:00.655358 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:18:00.760366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-84e9e886-5aca-42df-a1b6-150c8bef72c1 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 204 len: 0 microversion: 2.1 time: 0.168926 Dec 15 16:18:00.761398 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 521/1126] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:18:00 2021] DELETE /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:18:00.770623 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:00.771732 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:00.780397 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:00.781290 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:00.782275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:00.782895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:00.945592 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:00.955950 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bed9e474-73e1-4914-b140-40d923c1efd3 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1570 microversion: 2.1 time: 0.188958 Dec 15 16:18:00.957238 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 606/1127] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:00 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:01.021180 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-562bd222-b66a-4e0d-a57f-679560071e26 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Action: 'create', calling method: .version_select at 0x7f88b8071940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1108735038", "metadata": {"Type": "work"}}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:01.022646 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-562bd222-b66a-4e0d-a57f-679560071e26 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:01.023633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-562bd222-b66a-4e0d-a57f-679560071e26 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121522 Dec 15 16:18:01.024469 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 522/1128] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 16:18:00 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 16:18:01.035413 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ae90ee6-a6de-46eb-91dc-ee535ee67064 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Action: 'create', calling method: .version_select at 0x7f88b8c7a1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1721926820", "metadata": {"Type": "work"}}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:01.036428 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ae90ee6-a6de-46eb-91dc-ee535ee67064 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:01.037942 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ae90ee6-a6de-46eb-91dc-ee535ee67064 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007027 Dec 15 16:18:01.038586 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 607/1129] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 16:18:01 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:18:01.048744 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-889b6432-5c37-4f09-861e-7c08886c477d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Action: 'create', calling method: .version_select at 0x7f88b80711f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-413233626", "metadata": {"Type": "work"}}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:01.050324 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-889b6432-5c37-4f09-861e-7c08886c477d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:01.051216 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-889b6432-5c37-4f09-861e-7c08886c477d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005992 Dec 15 16:18:01.051962 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 523/1130] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 16:18:01 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:18:01.061750 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98984024-5b24-40a3-bf84-5770d638616f tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Calling method '.version_select at 0x7f88abf4c160>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:01.091222 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-98984024-5b24-40a3-bf84-5770d638616f tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] HTTP exception thrown: Volume tempest-invalid-2126718779 could not be found. Dec 15 16:18:01.091822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98984024-5b24-40a3-bf84-5770d638616f tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Returning 404 to user: Volume tempest-invalid-2126718779 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:01.092653 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98984024-5b24-40a3-bf84-5770d638616f tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2126718779" status: 404 len: 99 microversion: 2.1 time: 0.035256 Dec 15 16:18:01.093184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 608/1131] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Dec 15 16:18:01 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2126718779 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:18:01.104252 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1ef712c1-3287-4a5b-9a63-5c045f1a6fe4 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004662 Dec 15 16:18:01.104942 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 524/1132] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Dec 15 16:18:01 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:18:01.115104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66bf757b-9a9d-4b61-b726-94d260899cc0 tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003612 Dec 15 16:18:01.115741 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 609/1133] 10.222.0.36 () {58 vars in 1136 bytes} [Wed Dec 15 16:18:01 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:18:01.125410 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-22a855f6-ceaf-4551-b931-99c631a9862d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Calling method '.version_select at 0x7f88b80711f0>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:01.154371 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-22a855f6-ceaf-4551-b931-99c631a9862d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] HTTP exception thrown: Volume e38d11de-da6c-416a-9aeb-7e76fcc94a3f could not be found. Dec 15 16:18:01.154990 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-22a855f6-ceaf-4551-b931-99c631a9862d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Returning 404 to user: Volume e38d11de-da6c-416a-9aeb-7e76fcc94a3f could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:01.155818 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-22a855f6-ceaf-4551-b931-99c631a9862d tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e38d11de-da6c-416a-9aeb-7e76fcc94a3f" status: 404 len: 109 microversion: 2.1 time: 0.033979 Dec 15 16:18:01.156513 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 525/1134] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Dec 15 16:18:01 2021] DELETE /compute/v2.1/os-volumes/e38d11de-da6c-416a-9aeb-7e76fcc94a3f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:18:01.165892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3077298a-7303-41d8-83f4-26ebc9132f0a tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Calling method '.version_select at 0x7f88abf001f0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:01.193531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-3077298a-7303-41d8-83f4-26ebc9132f0a tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] HTTP exception thrown: Volume 2c206cd4-5858-4fa9-9fa1-f672e6163d76 could not be found. Dec 15 16:18:01.194144 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3077298a-7303-41d8-83f4-26ebc9132f0a tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] Returning 404 to user: Volume 2c206cd4-5858-4fa9-9fa1-f672e6163d76 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:01.195786 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3077298a-7303-41d8-83f4-26ebc9132f0a tempest-VolumesNegativeTest-1048868601 tempest-VolumesNegativeTest-1048868601-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2c206cd4-5858-4fa9-9fa1-f672e6163d76" status: 404 len: 109 microversion: 2.1 time: 0.034302 Dec 15 16:18:01.196364 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 610/1135] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Dec 15 16:18:01 2021] GET /compute/v2.1/os-volumes/2c206cd4-5858-4fa9-9fa1-f672e6163d76 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:01.974724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:01.975435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:01.981910 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:01.982353 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:01.983144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:01.983554 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:02.157400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:02.164771 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8593b05-c6bd-4bb4-9aec-48999ad502f5 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1451 microversion: 2.1 time: 0.194046 Dec 15 16:18:02.165759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 526/1136] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:01 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1451 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:02.948400 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-49be6817-a555-483d-bf14-f275b92cb52e req-8a9d35ce-9ab2-4245-bc74-86e053eb9e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cc388e-bd13-4a79-92d4-f32fcf891aaa", "name": "network-vif-deleted", "tag": "2c2b22cb-7362-4ca4-9251-1a506d1f65bc"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:02.951197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:02.951197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:18:02.960666 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-49be6817-a555-483d-bf14-f275b92cb52e req-8a9d35ce-9ab2-4245-bc74-86e053eb9e6b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:02.961091 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-49be6817-a555-483d-bf14-f275b92cb52e req-8a9d35ce-9ab2-4245-bc74-86e053eb9e6b service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:02.974665 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-49be6817-a555-483d-bf14-f275b92cb52e req-8a9d35ce-9ab2-4245-bc74-86e053eb9e6b service nova] Creating event network-vif-deleted:2c2b22cb-7362-4ca4-9251-1a506d1f65bc for instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa on hv-cinder-80070 Dec 15 16:18:02.980206 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-49be6817-a555-483d-bf14-f275b92cb52e req-8a9d35ce-9ab2-4245-bc74-86e053eb9e6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036642 Dec 15 16:18:02.980802 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 611/1137] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:18:03.182524 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:03.183227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:03.190261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:03.190782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:03.191644 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:03.192269 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:03.261774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa0c20019c84107b8324cd915ff78db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc22adb06b1e405ea619c273ffb94020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:03.269935 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2059edf5-5212-4b17-aa5f-f64e3866df40 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 200 len: 1220 microversion: 2.1 time: 0.091111 Dec 15 16:18:03.270511 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 527/1138] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:03 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:04.287993 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:04.288604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] [instance: 42cc388e-bd13-4a79-92d4-f32fcf891aaa] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:04.295505 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:04.295949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:04.296725 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:04.297156 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:04.310380 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] HTTP exception thrown: Instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa could not be found. Dec 15 16:18:04.310959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Returning 404 to user: Instance 42cc388e-bd13-4a79-92d4-f32fcf891aaa could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:04.311795 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0eb42f54-5965-4062-9423-44fc8423156d tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa" status: 404 len: 111 microversion: 2.1 time: 0.028393 Dec 15 16:18:04.312314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 612/1139] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:04 2021] GET /compute/v2.1/servers/42cc388e-bd13-4a79-92d4-f32fcf891aaa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:04.467616 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-7c1df83f-7317-438e-bb1e-b0255ad7b3f4 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] Calling method '.version_select at 0x7f88b8071430>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:04.492913 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-7c1df83f-7317-438e-bb1e-b0255ad7b3f4 tempest-TestShelveInstance-426055818 tempest-TestShelveInstance-426055818-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1178071824" status: 202 len: 0 microversion: 2.1 time: 0.028923 Dec 15 16:18:04.493564 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 528/1140] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Dec 15 16:18:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1178071824 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:18:06.121977 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:06.122889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:06.129263 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:06.129735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:06.130519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:06.130951 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:06.161120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-49a30c7e-9de6-4c85-9c96-16eb4986ee2b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042938 Dec 15 16:18:06.161935 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 613/1141] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:18:06 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:06.408525 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:06.409003 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:06.418339 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:06.418864 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:06.419466 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:06.420081 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:06.468917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8cc828bb-bc9e-48f9-b4c7-ccc6f7d1a1b8 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f" status: 200 len: 194 microversion: 2.1 time: 0.066458 Dec 15 16:18:06.469814 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 529/1142] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Dec 15 16:18:06 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:06.480000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:06.480493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:06.486693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:06.487370 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:06.488148 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:06.488578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:06.570741 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lazy-loading 'services' on Instance uuid d1f10094-2d7d-44fa-9078-a104e2e6ef84 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:18:06.653197 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-29cad964-865a-4063-a0af-e49455e75380 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f" status: 202 len: 0 microversion: 2.1 time: 0.177948 Dec 15 16:18:06.654517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 614/1143] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:18:06 2021] DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/9e130a28-de79-4ab0-8a4b-0f1c5edd2a2f => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:18:07.850255 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:07.851384 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:07.858961 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:07.859718 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:07.860983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:07.861653 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:07.895301 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-19c353c4-6d17-4763-ba77-3271a7b962de tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/61da75af-c0f2-4ca6-b379-f850a5d07552" status: 200 len: 194 microversion: 2.1 time: 0.054327 Dec 15 16:18:07.895909 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 530/1144] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Dec 15 16:18:07 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/61da75af-c0f2-4ca6-b379-f850a5d07552 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:07.906781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:07.907555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:07.918673 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:07.920404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:07.922006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:07.929425 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:08.028072 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lazy-loading 'services' on Instance uuid d1f10094-2d7d-44fa-9078-a104e2e6ef84 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:18:08.116503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1732948b-ec19-4260-8e16-4767e8c843e0 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/61da75af-c0f2-4ca6-b379-f850a5d07552" status: 202 len: 0 microversion: 2.1 time: 0.213754 Dec 15 16:18:08.117101 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 615/1145] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:18:07 2021] DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments/61da75af-c0f2-4ca6-b379-f850a5d07552 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:18:09.334520 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:09.335374 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:09.342340 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.342794 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.343575 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.344123 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.373914 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8924996e-022e-4774-93c1-be9d40fd91f9 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043052 Dec 15 16:18:09.375009 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 531/1146] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:18:09 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:18:09.484763 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:09.486638 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:09.493774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.494224 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.495162 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.495602 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.530284 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e5e6556d-253b-4b35-a374-176b8f936390 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049984 Dec 15 16:18:09.530843 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 616/1147] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Dec 15 16:18:09 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:18:09.592125 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:09.592615 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:09.599741 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.600193 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.601151 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.601772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.630231 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:18:09.730345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b72010e6-d873-4b0b-9c78-d1f5b804ab48 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 204 len: 0 microversion: 2.1 time: 0.142235 Dec 15 16:18:09.731060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 532/1148] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:18:09 2021] DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:18:09.739217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:09.740165 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:09.746718 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.747161 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:09.747921 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:09.748523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:10.017650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:10.028570 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d7d43f36-5bd7-4937-82e0-8ab5534a5164 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1675 microversion: 2.1 time: 0.292974 Dec 15 16:18:10.029339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 617/1149] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:09 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1675 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:11.047395 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:11.048002 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:11.061140 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:11.062035 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:11.063178 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:11.063819 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:11.234978 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:11.247081 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ecf3efb0-9e91-4e0f-9642-13fa430836ba tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1675 microversion: 2.1 time: 0.203905 Dec 15 16:18:11.248415 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 533/1150] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:11 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:12.264686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:12.266099 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:12.272442 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:12.272964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:12.273842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:12.274517 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:12.432395 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:12.441844 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-57028177-9a0a-4181-a64f-8c4f9894e6e3 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1675 microversion: 2.1 time: 0.180911 Dec 15 16:18:12.452070 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 618/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:12 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:12.982270 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-9ab12f38-9006-4008-9523-62f2ecb17343 req-526da4f2-3feb-46ca-acd7-4026441eab3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f10094-2d7d-44fa-9078-a104e2e6ef84", "name": "network-vif-deleted", "tag": "ae641ced-6e64-46f2-ad18-9b3191eb38ed"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:12.984119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:12.984119 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:18:13.002386 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-9ab12f38-9006-4008-9523-62f2ecb17343 req-526da4f2-3feb-46ca-acd7-4026441eab3d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:13.004677 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-9ab12f38-9006-4008-9523-62f2ecb17343 req-526da4f2-3feb-46ca-acd7-4026441eab3d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:13.326264 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-9ab12f38-9006-4008-9523-62f2ecb17343 req-526da4f2-3feb-46ca-acd7-4026441eab3d service nova] Creating event network-vif-deleted:ae641ced-6e64-46f2-ad18-9b3191eb38ed for instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 on hv-cinder-80070 Dec 15 16:18:13.335809 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-9ab12f38-9006-4008-9523-62f2ecb17343 req-526da4f2-3feb-46ca-acd7-4026441eab3d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358331 Dec 15 16:18:13.341229 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 534/1152] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:18:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:13.459449 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:13.460460 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:13.467699 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:13.468339 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:13.469296 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:13.469765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:13.510688 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:13.512023 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:13.512689 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lazy-loading 'fault' on Instance uuid d1f10094-2d7d-44fa-9078-a104e2e6ef84 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:18:13.563336 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff251ac504444235af8055f7a9c8e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710c6a0383874f9b946e8376a79787b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:13.571499 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-626d520c-21d6-45c7-a2ba-a365203dc6bc tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 200 len: 1327 microversion: 2.1 time: 0.115754 Dec 15 16:18:13.577842 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 619/1153] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:13 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:14.590018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:14.590699 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:14.597040 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:14.597546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:14.598351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:14.598775 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:14.612245 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] HTTP exception thrown: Instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 could not be found. Dec 15 16:18:14.612830 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Returning 404 to user: Instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:14.613675 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-eea9a2fe-a912-4d75-bea1-da59fa765120 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 404 len: 111 microversion: 2.1 time: 0.027987 Dec 15 16:18:14.614199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 535/1154] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:14 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:18:14.623001 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b1d890e6-da81-482f-9cbc-6846b7c5a872 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '.version_select at 0x7f88b8ac0ee0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:14.640659 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b1d890e6-da81-482f-9cbc-6846b7c5a872 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618585747" status: 202 len: 0 microversion: 2.1 time: 0.021797 Dec 15 16:18:14.641258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 620/1155] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Dec 15 16:18:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618585747 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:18:17.563144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:17.563622 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:17.569894 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:17.570258 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:17.571024 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:17.571453 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:17.584851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] HTTP exception thrown: Instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 could not be found. Dec 15 16:18:17.585494 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Returning 404 to user: Instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:17.586359 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-b292e140-3654-4e1f-b6e6-57dc275ceb7b tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 404 len: 111 microversion: 2.1 time: 0.026818 Dec 15 16:18:17.586923 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 536/1156] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:18:17 2021] DELETE /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:17.595734 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:17.596352 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: d1f10094-2d7d-44fa-9078-a104e2e6ef84] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:17.603061 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:17.603510 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:17.604835 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:17.605274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:17.617735 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] HTTP exception thrown: Instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 could not be found. Dec 15 16:18:17.618324 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Returning 404 to user: Instance d1f10094-2d7d-44fa-9078-a104e2e6ef84 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:17.619145 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d2394373-1b1a-4420-9aac-f77230cfe2db tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84" status: 404 len: 111 microversion: 2.1 time: 0.027693 Dec 15 16:18:17.620274 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 621/1157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:17 2021] GET /compute/v2.1/servers/d1f10094-2d7d-44fa-9078-a104e2e6ef84 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:18.750196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:18.750744 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:18.756972 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:18.757438 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:18.758213 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:18.758639 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:18.773783 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] HTTP exception thrown: Instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e could not be found. Dec 15 16:18:18.774374 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Returning 404 to user: Instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:18.775217 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-34c9ad7b-a710-48f7-8461-7b72e19e50d4 tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 404 len: 111 microversion: 2.1 time: 0.028696 Dec 15 16:18:18.776635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 537/1158] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:18:18 2021] DELETE /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:18.784479 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:18.785093 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] [instance: 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:18.793362 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:18.794217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:18.795629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:18.796443 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:18.812911 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] HTTP exception thrown: Instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e could not be found. Dec 15 16:18:18.813547 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] Returning 404 to user: Instance 9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:18:18.814418 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-52a950f9-36f1-488b-ba21-eb1e39ce309e tempest-AttachVolumeTestJSON-1034395193 tempest-AttachVolumeTestJSON-1034395193-project] 10.222.0.36 "GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e" status: 404 len: 111 microversion: 2.1 time: 0.033749 Dec 15 16:18:18.814976 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 622/1159] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:18 2021] GET /compute/v2.1/servers/9a4868f1-c75f-46f6-8dc9-1c70a8e6a18e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:18:37.054899 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1275025133", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "f6c752ec-247b-4694-a331-3b7b3b2bdbae"}]}} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:37.105588 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.network.neutron [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] validate_networks() for [('f6c752ec-247b-4694-a331-3b7b3b2bdbae', None, None, None, None, None)] {{(pid=116083) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:18:37.458447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Flavor limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:18:37.458863 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Image limits 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:18:37.459328 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Flavor pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:18:37.459728 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Image pref 0:0:0 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:18:37.460130 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.virt.hardware [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:18:37.469495 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:37.469938 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:37.470746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:37.471175 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:37.487827 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Getting quotas for project e15dc48faa0c423e9cfb7e34facc959b. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:18:37.491635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.quota [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Getting quotas for user dfb43739519b44368e274c788031766b and project e15dc48faa0c423e9cfb7e34facc959b. Resources: {'instances', 'cores', 'ram'} {{(pid=116083) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:18:37.501896 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Going to run 1 instances... {{(pid=116083) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:18:37.504185 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:18:37.563085 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a12ed849-6db9-498e-ab70-5c0d16ae7fd2 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511883 Dec 15 16:18:37.568605 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 538/1160] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:18:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:18:37.574214 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3e211ab5-4ff7-48ce-a52d-0acfb7d03c28 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:37.574814 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3e211ab5-4ff7-48ce-a52d-0acfb7d03c28 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:37.670833 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3e211ab5-4ff7-48ce-a52d-0acfb7d03c28 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:37.679191 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3e211ab5-4ff7-48ce-a52d-0acfb7d03c28 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1219 microversion: 2.1 time: 0.108806 Dec 15 16:18:37.679989 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 623/1161] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:37 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:18:38.696623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:38.697495 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:38.706352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:38.706868 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:38.707720 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:38.708238 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:38.775351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:38.782723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1a783f82-4542-4c59-8b16-6916349c8087 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1277 microversion: 2.1 time: 0.090506 Dec 15 16:18:38.783283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 539/1162] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:38 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:39.800062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:39.800699 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:39.806923 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:39.807941 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:39.808892 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:39.809405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:39.950103 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:39.957886 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e458e211-1f00-4fcf-bb0b-9e848a24ca77 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.161507 Dec 15 16:18:39.958553 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 624/1163] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:39 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:40.135849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-385a2d58-c576-4721-b886-9b85691c78ea req-32349ffd-6687-4179-a19e-63a112a8df9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6432cc-8888-4121-b306-0dc278742654", "tag": "671ba484-ddef-4553-b17c-b5002c1504df"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:40.137461 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:40.137461 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:18:40.144623 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-385a2d58-c576-4721-b886-9b85691c78ea req-32349ffd-6687-4179-a19e-63a112a8df9f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:40.145059 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-385a2d58-c576-4721-b886-9b85691c78ea req-32349ffd-6687-4179-a19e-63a112a8df9f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:40.160192 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-385a2d58-c576-4721-b886-9b85691c78ea req-32349ffd-6687-4179-a19e-63a112a8df9f service nova] Creating event network-changed:671ba484-ddef-4553-b17c-b5002c1504df for instance ec6432cc-8888-4121-b306-0dc278742654 on hv-cinder-80070 Dec 15 16:18:40.164983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-385a2d58-c576-4721-b886-9b85691c78ea req-32349ffd-6687-4179-a19e-63a112a8df9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032828 Dec 15 16:18:40.165842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 540/1164] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:40.974880 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:40.975523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:40.982239 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:40.982677 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:40.983447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:40.983874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:41.115414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:41.123212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ffd40d36-c001-4324-b05b-079e4a7ca82a tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.152008 Dec 15 16:18:41.124018 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 625/1165] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:40 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:42.140698 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:42.141401 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:42.147458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:42.147898 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:42.148665 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:42.149096 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:42.280967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:42.287996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-10d10adb-1c0d-4dbd-a4fd-064bec802101 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.151772 Dec 15 16:18:42.288542 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 541/1166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:42 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:43.305419 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:43.305947 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:43.312142 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:43.312582 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:43.313376 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:43.313826 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:43.447728 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:43.455536 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9b7338fa-eeac-4259-bd71-7b63aa9a7959 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.153836 Dec 15 16:18:43.456112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 626/1167] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:43 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:44.472155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:44.472882 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:44.479700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:44.480306 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:44.481100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:44.481577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:44.611940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:44.619172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-81e3f43a-02bf-4af7-b77f-46cac5bbee16 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.150687 Dec 15 16:18:44.619728 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 542/1168] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:44 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:45.637595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:45.638208 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:45.644534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:45.644982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:45.645979 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:45.646401 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:45.811542 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:45.819820 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6716593f-191a-441a-9b0b-83b54e99e323 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.186159 Dec 15 16:18:45.820857 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 627/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:45 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:46.837562 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:46.838196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:46.844985 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:46.845473 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:46.846257 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:46.846774 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:46.985767 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:46.992983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-524c0446-cc80-42e1-90c9-11ce53e043b0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.159238 Dec 15 16:18:46.993574 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 543/1170] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:46 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:47.872783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-6914ccfd-5e80-417e-8ba0-9d36e32909fa req-f4607a99-8279-4552-96f9-846adf0f0fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6432cc-8888-4121-b306-0dc278742654", "name": "network-vif-plugged", "status": "completed", "tag": "671ba484-ddef-4553-b17c-b5002c1504df"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:18:47.874399 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:47.874399 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:18:47.882706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-6914ccfd-5e80-417e-8ba0-9d36e32909fa req-f4607a99-8279-4552-96f9-846adf0f0fb2 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:47.883788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-6914ccfd-5e80-417e-8ba0-9d36e32909fa req-f4607a99-8279-4552-96f9-846adf0f0fb2 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:47.895595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-6914ccfd-5e80-417e-8ba0-9d36e32909fa req-f4607a99-8279-4552-96f9-846adf0f0fb2 service nova] Creating event network-vif-plugged:671ba484-ddef-4553-b17c-b5002c1504df for instance ec6432cc-8888-4121-b306-0dc278742654 on hv-cinder-80070 Dec 15 16:18:47.900622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-6914ccfd-5e80-417e-8ba0-9d36e32909fa req-f4607a99-8279-4552-96f9-846adf0f0fb2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 Dec 15 16:18:47.901406 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 628/1171] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:18:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:18:48.009983 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:48.010608 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:48.017643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:48.018087 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:48.018928 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:48.019360 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:48.204956 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:48.212501 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1bebf30e-ec29-416b-a922-b7d9519fdbd8 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.206217 Dec 15 16:18:48.213062 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 544/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:48 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:18:49.232557 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:49.232557 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:49.239980 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:49.240379 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:49.241169 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:49.241639 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:49.402004 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:49.410157 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ca2efd92-e748-4da9-9caf-3208ffb12822 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1319 microversion: 2.1 time: 0.183737 Dec 15 16:18:49.411519 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 629/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:49 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:18:50.427823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:50.428444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:18:50.435143 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:50.435585 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:50.436387 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:50.436817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:50.567047 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:18:50.574311 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-fe1b3214-eb64-4b18-b61b-cc8c9df52302 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1507 microversion: 2.1 time: 0.150130 Dec 15 16:18:50.574867 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 545/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:18:50 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:15.055937 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e915c00-87e4-45a4-a605-1684cba302ad", "device": "/dev/sdb"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:15.057531 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:15.063646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.064126 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.064900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.065335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.294537 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-143c0b0f-6985-4eeb-b193-444cfaa84188 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "POST /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242306 Dec 15 16:19:15.295150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 630/1175] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:19:15 2021] POST /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:19:49.682801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:49.683393 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:49.689454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:49.689903 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:49.690670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:49.691096 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:49.714903 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:19:49.786759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-048ab8d0-2fd7-4137-aaee-711f1068338a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 204 len: 0 microversion: 2.1 time: 0.107458 Dec 15 16:19:49.787494 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 546/1176] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:19:49 2021] DELETE /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:19:49.797578 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:49.798288 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:49.804427 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:49.804884 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:49.805686 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:49.806124 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:49.937861 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:49.945146 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-76b48d18-1df4-4d4b-a236-758e136dcf4e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1578 microversion: 2.1 time: 0.153289 Dec 15 16:19:49.945770 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 631/1177] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:49 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:50.962716 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:50.963444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:50.970356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:50.970809 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:50.971596 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:50.972059 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:51.102604 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:51.110390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2f7477b5-9ac1-4486-a84d-4a1694122e78 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1578 microversion: 2.1 time: 0.151687 Dec 15 16:19:51.110967 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 547/1178] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:50 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:51.431059 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:51.431640 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:51.437804 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:51.438244 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:51.439013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:51.439439 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:51.516199 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lazy-loading 'services' on Instance uuid ec6432cc-8888-4121-b306-0dc278742654 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:19:51.584624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-724831cf-3db8-4dd2-ac72-deabbabe58cc tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654/os-volume_attachments/8e915c00-87e4-45a4-a605-1684cba302ad" status: 202 len: 0 microversion: 2.1 time: 0.157206 Dec 15 16:19:51.585215 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 632/1179] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:19:51 2021] DELETE /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654/os-volume_attachments/8e915c00-87e4-45a4-a605-1684cba302ad => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:19:52.128098 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:52.128711 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:52.134971 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.135419 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:52.136199 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.136628 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:52.223891 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:52.232926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1da70eb5-dac1-487e-9cc2-f9784e1dedae tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1510 microversion: 2.1 time: 0.108477 Dec 15 16:19:52.233613 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 548/1180] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:52 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1510 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:52.507761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-db95d92e-f781-4fdc-a869-8b64ca390137 req-4e70f3bb-1320-45ef-b2ac-a25e6dc20934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a17033c-80a1-4a18-add4-7d228b7ea5e9", "name": "network-vif-deleted", "tag": "1e90e512-10b9-4ab9-885d-f0050132cce7"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:52.507761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:52.507761 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:19:52.516647 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-db95d92e-f781-4fdc-a869-8b64ca390137 req-4e70f3bb-1320-45ef-b2ac-a25e6dc20934 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.517228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-db95d92e-f781-4fdc-a869-8b64ca390137 req-4e70f3bb-1320-45ef-b2ac-a25e6dc20934 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:52.539388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-db95d92e-f781-4fdc-a869-8b64ca390137 req-4e70f3bb-1320-45ef-b2ac-a25e6dc20934 service nova] Creating event network-vif-deleted:1e90e512-10b9-4ab9-885d-f0050132cce7 for instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 on hv-cinder-80070 Dec 15 16:19:52.547893 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-db95d92e-f781-4fdc-a869-8b64ca390137 req-4e70f3bb-1320-45ef-b2ac-a25e6dc20934 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048179 Dec 15 16:19:52.548693 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 633/1181] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:19:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:52.709052 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:52.710260 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:52.730469 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.732366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:52.734356 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.738926 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:52.768952 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:19:52.852172 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-36c62ef2-54f1-4135-bbec-706fd3f97986 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 204 len: 0 microversion: 2.1 time: 0.149876 Dec 15 16:19:52.852848 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 549/1182] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:19:52 2021] DELETE /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:19:52.864805 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:52.866287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:52.875571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.876012 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:52.877015 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:52.878908 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:53.022246 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:53.030009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1e1697cc-3925-44ec-a1d4-e6d2eeb9df24 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1513 microversion: 2.1 time: 0.171706 Dec 15 16:19:53.030581 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 634/1183] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:52 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:53.251727 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:53.253038 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:53.260458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:53.261068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:53.262076 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:53.262849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:53.310435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:53.310966 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:53.311413 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lazy-loading 'fault' on Instance uuid 6a17033c-80a1-4a18-add4-7d228b7ea5e9 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:19:53.354759 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:53.363319 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d546727e-41ba-433c-b3d9-746ac389879d tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 200 len: 1184 microversion: 2.1 time: 0.116033 Dec 15 16:19:53.363934 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 550/1184] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:53 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 1184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:54.047651 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:54.048258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:54.054662 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:54.055090 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:54.055868 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:54.056303 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:54.186857 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:54.194035 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b76e09c0-a7e2-45ac-a25a-e5caac2fef85 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1513 microversion: 2.1 time: 0.150865 Dec 15 16:19:54.194596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 635/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:54 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:54.380613 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:54.381218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:54.387992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:54.388435 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:54.389209 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:54.389670 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:54.402188 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] HTTP exception thrown: Instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 could not be found. Dec 15 16:19:54.403403 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Returning 404 to user: Instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:19:54.404211 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1951aae8-a913-47d8-ad32-dcee2c74f04a tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 404 len: 111 microversion: 2.1 time: 0.027296 Dec 15 16:19:54.404721 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 551/1186] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:54 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:19:54.500590 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-182276426", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-668839965", "security_groups": [{"name": "tempest-secgroup-smoke-1366060423"}], "block_device_mapping_v2": [{"uuid": "12f1f2d4-dd5e-4a42-8154-7fbcd0d600d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6bf17fcc-7520-487a-8b2c-b8aaa08a20f8"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:54.607442 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] validate_networks() for [('6bf17fcc-7520-487a-8b2c-b8aaa08a20f8', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:19:54.976174 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:19:54.976606 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:19:54.977083 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:19:54.977535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:19:54.977949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:19:54.986634 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:54.987081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:54.987900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:54.988341 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:55.005495 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for project d37336bbfbab45f79ed53d56efe617c4. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:19:55.009356 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for user 0c89b280c0864631a57aab8564633443 and project d37336bbfbab45f79ed53d56efe617c4. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:19:55.071414 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:19:55.074069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12f1f2d4-dd5e-4a42-8154-7fbcd0d600d7',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:19:55.133548 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-a95a8bf5-73d8-4dbf-b807-2ef6c0098fe0 req-70296a34-66db-4060-bac0-25607397c7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6432cc-8888-4121-b306-0dc278742654", "name": "network-vif-deleted", "tag": "671ba484-ddef-4553-b17c-b5002c1504df"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:55.135034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:55.135034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:19:55.141979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a95a8bf5-73d8-4dbf-b807-2ef6c0098fe0 req-70296a34-66db-4060-bac0-25607397c7d0 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:55.142446 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-a95a8bf5-73d8-4dbf-b807-2ef6c0098fe0 req-70296a34-66db-4060-bac0-25607397c7d0 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:55.153377 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-a95a8bf5-73d8-4dbf-b807-2ef6c0098fe0 req-70296a34-66db-4060-bac0-25607397c7d0 service nova] Creating event network-vif-deleted:671ba484-ddef-4553-b17c-b5002c1504df for instance ec6432cc-8888-4121-b306-0dc278742654 on hv-cinder-80070 Dec 15 16:19:55.158996 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-a95a8bf5-73d8-4dbf-b807-2ef6c0098fe0 req-70296a34-66db-4060-bac0-25607397c7d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028862 Dec 15 16:19:55.160817 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 552/1187] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:19:55.210755 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:55.211447 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:55.217844 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:55.218300 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:55.219095 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:55.219521 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:55.233827 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d1dd267-1208-477b-8cb5-961f6b0e2ea0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736841 Dec 15 16:19:55.234421 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 636/1188] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:19:54 2021] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:19:55.245075 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ae326a3-b04d-4f4f-a20a-608a7ef8cc08 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:55.245713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ae326a3-b04d-4f4f-a20a-608a7ef8cc08 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:55.259886 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:55.260327 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:55.260769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lazy-loading 'fault' on Instance uuid ec6432cc-8888-4121-b306-0dc278742654 {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:19:55.302417 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ae326a3-b04d-4f4f-a20a-608a7ef8cc08 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:55.303706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:55.308960 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ae326a3-b04d-4f4f-a20a-608a7ef8cc08 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1093 microversion: 2.1 time: 0.068518 Dec 15 16:19:55.310502 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 637/1189] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:55 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:19:55.311951 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ee00b9d9-e8c8-4793-8723-d3d9efd6500c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 200 len: 1309 microversion: 2.1 time: 0.105079 Dec 15 16:19:55.312505 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 553/1190] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:55 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:19:56.326690 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1e7666c0-0b09-4aa1-b9e7-49841b24b995 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:56.327134 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1e7666c0-0b09-4aa1-b9e7-49841b24b995 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:56.328133 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:56.328746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: ec6432cc-8888-4121-b306-0dc278742654] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:56.334851 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:56.335298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:56.336074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:56.336503 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:56.349746 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] HTTP exception thrown: Instance ec6432cc-8888-4121-b306-0dc278742654 could not be found. Dec 15 16:19:56.350345 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Returning 404 to user: Instance ec6432cc-8888-4121-b306-0dc278742654 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:19:56.351196 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-8e30a23c-7948-4354-bee4-6703d90066f9 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654" status: 404 len: 111 microversion: 2.1 time: 0.027019 Dec 15 16:19:56.351738 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 554/1191] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:56 2021] GET /compute/v2.1/servers/ec6432cc-8888-4121-b306-0dc278742654 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:19:56.387851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1e7666c0-0b09-4aa1-b9e7-49841b24b995 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:56.394168 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1e7666c0-0b09-4aa1-b9e7-49841b24b995 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1093 microversion: 2.1 time: 0.071499 Dec 15 16:19:56.394737 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 638/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:56 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:57.411070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ddde5ff9-a278-469a-b3c3-e1ef98a57c03 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:57.411673 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ddde5ff9-a278-469a-b3c3-e1ef98a57c03 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:57.469788 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ddde5ff9-a278-469a-b3c3-e1ef98a57c03 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:57.476366 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ddde5ff9-a278-469a-b3c3-e1ef98a57c03 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1093 microversion: 2.1 time: 0.069064 Dec 15 16:19:57.476918 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 555/1193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:57 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:58.492486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-016a5544-d035-41de-9cb9-9ede853d10c9 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:58.493096 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-016a5544-d035-41de-9cb9-9ede853d10c9 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:58.546286 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-016a5544-d035-41de-9cb9-9ede853d10c9 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:58.552939 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-016a5544-d035-41de-9cb9-9ede853d10c9 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1093 microversion: 2.1 time: 0.064080 Dec 15 16:19:58.562521 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 639/1194] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:58 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:59.570066 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:59.570698 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:59.579029 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:59.579475 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:59.580251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:59.580682 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:59.641723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:59.649113 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1564a2a2-4d68-48ee-82c3-d613986edd6b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1143 microversion: 2.1 time: 0.082712 Dec 15 16:19:59.649706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 556/1195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:59 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:00.668141 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:00.670361 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:00.686457 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:00.687504 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:00.688562 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:00.689051 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:00.777486 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:00.788773 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4dc57da9-8712-4123-9644-1ae9f29be283 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1209 microversion: 2.1 time: 0.124855 Dec 15 16:20:00.800122 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 640/1196] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:00 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:01.573675 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-1f64e78c-6323-499c-99db-3587789baf48 req-bf543c22-6c91-4859-abc3-921d90dc60c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819b4a9c-2da2-40d7-917d-bb9475f1874a", "tag": "764c6fb7-9c23-438e-a0c8-71a2e0c0ef74"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:01.576700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:01.576700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:20:01.585262 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1f64e78c-6323-499c-99db-3587789baf48 req-bf543c22-6c91-4859-abc3-921d90dc60c7 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:01.585747 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-1f64e78c-6323-499c-99db-3587789baf48 req-bf543c22-6c91-4859-abc3-921d90dc60c7 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:01.597034 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-1f64e78c-6323-499c-99db-3587789baf48 req-bf543c22-6c91-4859-abc3-921d90dc60c7 service nova] Creating event network-changed:764c6fb7-9c23-438e-a0c8-71a2e0c0ef74 for instance 819b4a9c-2da2-40d7-917d-bb9475f1874a on hv-cinder-80070 Dec 15 16:20:01.601947 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-1f64e78c-6323-499c-99db-3587789baf48 req-bf543c22-6c91-4859-abc3-921d90dc60c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032905 Dec 15 16:20:01.602541 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 557/1197] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:20:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:01.808019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:01.808534 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:01.814886 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:01.815411 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:01.816388 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:01.816822 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:01.960949 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:01.968765 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-646d3a40-c771-4dc4-84ae-f54fe698d757 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.164559 Dec 15 16:20:01.969964 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 641/1198] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:01 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:02.987338 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:02.988021 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:02.994011 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:02.994449 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:02.995207 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:02.995633 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:03.136476 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:03.144595 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-2f212b19-ac4a-4e86-8bdf-cc55ad729462 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.161654 Dec 15 16:20:03.145149 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 558/1199] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:02 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:04.161153 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:04.161781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:04.169167 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:04.169650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:04.170668 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:04.171104 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:04.303433 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:04.311240 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef4d4607-5346-440a-a543-ac64dc8467b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.153864 Dec 15 16:20:04.311817 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 642/1200] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:04 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:05.328389 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:05.329642 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:05.335822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:05.336272 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:05.337051 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:05.337515 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:05.467506 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:05.474681 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-da3977b0-020f-4595-997c-b15af2000e21 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.150689 Dec 15 16:20:05.475243 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 559/1201] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:05 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:06.213576 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1099632983", "imageRef": "e6fb6674-20e5-4e6b-8b99-3a823d82ca33", "flavorRef": "452", "networks": [{"uuid": "f6c752ec-247b-4694-a331-3b7b3b2bdbae"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:06.264442 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] validate_networks() for [('f6c752ec-247b-4694-a331-3b7b3b2bdbae', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:20:06.492071 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:06.492697 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:06.499455 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:06.499895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:06.500888 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:06.501322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:06.603874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:20:06.604317 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:20:06.604788 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:20:06.605195 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:20:06.605629 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:20:06.614717 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:06.615161 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:06.615971 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:06.616401 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:06.631667 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:06.633127 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Getting quotas for project e15dc48faa0c423e9cfb7e34facc959b. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:20:06.637006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Getting quotas for user dfb43739519b44368e274c788031766b and project e15dc48faa0c423e9cfb7e34facc959b. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:20:06.639423 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cc588019-8346-4bb7-bae3-ee930595703c tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.151032 Dec 15 16:20:06.639992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 560/1202] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:06 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:06.648386 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:20:06.650595 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fb6674-20e5-4e6b-8b99-3a823d82ca33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:20:06.695852 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ccaec477-f09a-4a30-a63a-5e7c51211df3 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485721 Dec 15 16:20:06.696497 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 643/1203] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:20:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:20:06.706619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-bdd68d5f-4f81-4be1-b4ac-ffa2a45e1385 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:06.707256 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-bdd68d5f-4f81-4be1-b4ac-ffa2a45e1385 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:06.760550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-bdd68d5f-4f81-4be1-b4ac-ffa2a45e1385 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:06.767902 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-bdd68d5f-4f81-4be1-b4ac-ffa2a45e1385 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1219 microversion: 2.1 time: 0.064717 Dec 15 16:20:06.768477 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 561/1204] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:06 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:07.656646 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:07.657355 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:07.663851 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:07.664301 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:07.665084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:07.665551 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:07.788106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:07.789789 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:07.799488 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:07.800569 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:07.801658 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:07.802100 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:07.810213 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:07.818742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-10e57c6c-5cc5-43cf-b9d3-b2e96f47a80f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.166433 Dec 15 16:20:07.819325 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 644/1205] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:07 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:07.898563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:07.910114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f6c46f21-c97a-4820-a0d7-40376f8d3bf4 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1289 microversion: 2.1 time: 0.129017 Dec 15 16:20:07.910621 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 562/1206] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:07 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1289 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:08.835184 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:08.835782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:08.842714 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:08.843154 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:08.843929 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:08.844356 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:08.926949 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:08.927629 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:08.935120 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:08.935887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:08.937037 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:08.937992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:08.981491 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:08.989783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-93051828-863b-430b-9227-edf9c9df43db tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.158116 Dec 15 16:20:08.990494 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 645/1207] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:08 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:08.998437 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-5cb1bfa0-f4fe-4063-93d9-c2f162fd4cdf req-6efb8e54-5d59-4d4a-a8dd-f9c1091ce06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8e2877-23a1-41d0-9488-93088de5933c", "tag": "44658c8a-c07f-4ee6-a771-2e1bc32f5a73"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:09.000496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:09.000496 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:20:09.009217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-5cb1bfa0-f4fe-4063-93d9-c2f162fd4cdf req-6efb8e54-5d59-4d4a-a8dd-f9c1091ce06d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:09.009938 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-5cb1bfa0-f4fe-4063-93d9-c2f162fd4cdf req-6efb8e54-5d59-4d4a-a8dd-f9c1091ce06d service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:09.022683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-5cb1bfa0-f4fe-4063-93d9-c2f162fd4cdf req-6efb8e54-5d59-4d4a-a8dd-f9c1091ce06d service nova] Creating event network-changed:44658c8a-c07f-4ee6-a771-2e1bc32f5a73 for instance db8e2877-23a1-41d0-9488-93088de5933c on hv-cinder-80070 Dec 15 16:20:09.028648 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-5cb1bfa0-f4fe-4063-93d9-c2f162fd4cdf req-6efb8e54-5d59-4d4a-a8dd-f9c1091ce06d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036053 Dec 15 16:20:09.029573 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 646/1208] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:20:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:09.195182 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:09.202437 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d1925997-1777-4919-bf72-4858df96ff12 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1319 microversion: 2.1 time: 0.279161 Dec 15 16:20:09.202992 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 563/1209] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:08 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:10.007990 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:10.008679 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:10.015335 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:10.015774 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:10.016548 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:10.016975 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:10.219753 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:10.220341 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:10.226669 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:10.227106 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:10.227887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:10.228314 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:10.368519 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:10.375912 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-76534503-4340-496c-aacd-07b8f39d7707 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1319 microversion: 2.1 time: 0.160247 Dec 15 16:20:10.376489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 564/1210] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:10 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:10.404334 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:10.411538 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7f3ed20d-ee13-4c3b-b405-2f0350ac311e tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.407981 Dec 15 16:20:10.412101 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 647/1211] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:10 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:11.392298 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:11.392904 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:11.399079 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:11.399525 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:11.400296 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:11.400724 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:11.429620 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:11.430228 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:11.436712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:11.437157 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:11.437978 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:11.438408 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:11.530444 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:11.537613 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-913fb40d-ab7f-46cb-bda6-981f54ce329f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1319 microversion: 2.1 time: 0.149004 Dec 15 16:20:11.538176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 565/1212] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:11 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:11.570657 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:11.578766 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8909b3f4-0069-476c-8a92-eb515d376390 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.152807 Dec 15 16:20:11.579326 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 648/1213] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:11 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:12.555251 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:12.555861 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:12.562147 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:12.562601 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:12.563387 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:12.563820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:12.596450 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:12.597775 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:12.604658 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:12.605200 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:12.606488 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:12.606668 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:12.699638 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:12.707857 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-cd3f415f-87d4-4868-8e0a-6d71c6aab423 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1319 microversion: 2.1 time: 0.156343 Dec 15 16:20:12.708430 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 566/1214] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:12 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:12.751811 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:12.759030 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f70371fc-e536-4f69-b52e-d2c003e3dc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.167503 Dec 15 16:20:12.759599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 649/1215] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:12 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:13.724373 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:13.724972 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:13.731185 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:13.731631 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:13.732403 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:13.732835 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:13.775778 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:13.776393 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:13.783000 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:13.784029 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:13.784819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:13.785280 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:13.865535 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:13.872689 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9e668f94-30ea-424a-9f89-5ba2f72c8998 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1319 microversion: 2.1 time: 0.151995 Dec 15 16:20:13.873403 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 567/1216] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:13 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:13.918233 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:13.929320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a3a2e1cb-9c73-45c2-beaa-868d5a4b11d0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.156847 Dec 15 16:20:13.929944 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 650/1217] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:13 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:14.335703 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-74332df0-692d-43fc-8ef4-72b571c30f36 req-86f47d4d-01a7-48a2-9d18-e02b7a07f66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8e2877-23a1-41d0-9488-93088de5933c", "name": "network-vif-plugged", "status": "completed", "tag": "44658c8a-c07f-4ee6-a771-2e1bc32f5a73"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:14.337271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:14.337271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:20:14.344458 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-74332df0-692d-43fc-8ef4-72b571c30f36 req-86f47d4d-01a7-48a2-9d18-e02b7a07f66f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:14.344917 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-74332df0-692d-43fc-8ef4-72b571c30f36 req-86f47d4d-01a7-48a2-9d18-e02b7a07f66f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:14.356399 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-74332df0-692d-43fc-8ef4-72b571c30f36 req-86f47d4d-01a7-48a2-9d18-e02b7a07f66f service nova] Creating event network-vif-plugged:44658c8a-c07f-4ee6-a771-2e1bc32f5a73 for instance db8e2877-23a1-41d0-9488-93088de5933c on hv-cinder-80070 Dec 15 16:20:14.361531 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-74332df0-692d-43fc-8ef4-72b571c30f36 req-86f47d4d-01a7-48a2-9d18-e02b7a07f66f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029310 Dec 15 16:20:14.362114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 568/1218] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:14.889961 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:14.890564 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:14.896738 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:14.897176 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:14.897983 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:14.898412 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:14.947632 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:14.948400 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:14.954417 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:14.954870 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:14.955645 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:14.956076 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:15.035268 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:15.043267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3242e4ad-a216-46aa-8f42-f1ab0dcba34f tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1319 microversion: 2.1 time: 0.156914 Dec 15 16:20:15.044053 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 651/1219] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:14 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:15.103386 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:15.111261 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-40d1bbfe-a984-4562-a3ce-fa0ba252d4b4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.168051 Dec 15 16:20:15.111820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 569/1220] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:14 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:16.061084 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:16.062081 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:16.068589 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.069038 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.069839 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.070267 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.127282 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:16.127940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:16.134706 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.135283 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.136061 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.136489 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.203372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:16.211022 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c4f677b2-0d91-4a6c-a136-68acbb8232c1 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1508 microversion: 2.1 time: 0.153615 Dec 15 16:20:16.211597 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 652/1221] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:16 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:16.227719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e4de79d-5236-4a54-8791-9ac04d974af6", "device": "/dev/sdb"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:16.228799 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:16.235158 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.235599 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.236493 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.236927 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.269055 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:16.276363 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f6531f51-07dd-4de8-b223-86a3b1083a2f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.153274 Dec 15 16:20:16.277105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 570/1222] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:16 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:16.381672 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-fafbc676-afcd-423c-9b94-6f94ca811c5f req-cece3673-3565-41fb-b0ab-a71f53a23a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819b4a9c-2da2-40d7-917d-bb9475f1874a", "name": "network-vif-plugged", "status": "completed", "tag": "764c6fb7-9c23-438e-a0c8-71a2e0c0ef74"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:16.383174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:16.383174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:20:16.390597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-fafbc676-afcd-423c-9b94-6f94ca811c5f req-cece3673-3565-41fb-b0ab-a71f53a23a1a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.391033 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-fafbc676-afcd-423c-9b94-6f94ca811c5f req-cece3673-3565-41fb-b0ab-a71f53a23a1a service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.402014 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-fafbc676-afcd-423c-9b94-6f94ca811c5f req-cece3673-3565-41fb-b0ab-a71f53a23a1a service nova] Creating event network-vif-plugged:764c6fb7-9c23-438e-a0c8-71a2e0c0ef74 for instance 819b4a9c-2da2-40d7-917d-bb9475f1874a on hv-cinder-80070 Dec 15 16:20:16.408476 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-fafbc676-afcd-423c-9b94-6f94ca811c5f req-cece3673-3565-41fb-b0ab-a71f53a23a1a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029903 Dec 15 16:20:16.409229 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 571/1223] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:20:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:16.473680 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1082d47f-1c33-4403-9601-8583a643b091 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "POST /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249005 Dec 15 16:20:16.474314 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 653/1224] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Dec 15 16:20:16 2021] POST /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:17.293361 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:17.293995 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:17.300736 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:17.301176 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:17.301963 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:17.302392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:17.435705 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:17.443563 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ec9061fe-d586-48e9-9766-e09825d285d6 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1265 microversion: 2.1 time: 0.154274 Dec 15 16:20:17.444121 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 572/1225] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:17 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:18.461306 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:18.462026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:18.469624 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:18.470121 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:18.470885 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:18.471313 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:18.602004 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:18.609373 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-442daab9-f5e2-4d8c-b260-b64c70aa1a89 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1452 microversion: 2.1 time: 0.152085 Dec 15 16:20:18.610014 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 654/1226] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:18 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:18.626064 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:18.626678 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:18.632536 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:18.632989 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:18.633798 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:18.634233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:18.771146 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:18.778326 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-f8594362-6ce0-4b5c-b666-c54b10f2b183 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1452 microversion: 2.1 time: 0.156813 Dec 15 16:20:18.778887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 573/1227] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:18 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:20.583247 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-4bd6f91d-0611-4c5d-9a4c-0bc4fe1e51e4 req-384210c0-f951-4d2e-a741-0f106c8a7ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819b4a9c-2da2-40d7-917d-bb9475f1874a", "tag": "764c6fb7-9c23-438e-a0c8-71a2e0c0ef74"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:20.585009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:20.585009 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:20:20.592555 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4bd6f91d-0611-4c5d-9a4c-0bc4fe1e51e4 req-384210c0-f951-4d2e-a741-0f106c8a7ae4 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:20.593959 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4bd6f91d-0611-4c5d-9a4c-0bc4fe1e51e4 req-384210c0-f951-4d2e-a741-0f106c8a7ae4 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:20.604843 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-4bd6f91d-0611-4c5d-9a4c-0bc4fe1e51e4 req-384210c0-f951-4d2e-a741-0f106c8a7ae4 service nova] Creating event network-changed:764c6fb7-9c23-438e-a0c8-71a2e0c0ef74 for instance 819b4a9c-2da2-40d7-917d-bb9475f1874a on hv-cinder-80070 Dec 15 16:20:20.610237 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-4bd6f91d-0611-4c5d-9a4c-0bc4fe1e51e4 req-384210c0-f951-4d2e-a741-0f106c8a7ae4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031009 Dec 15 16:20:20.610864 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 655/1228] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:34.634450 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:34.635015 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:34.641200 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:34.641700 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:34.642531 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:34.642960 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:34.720164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.objects.instance [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lazy-loading 'services' on Instance uuid db8e2877-23a1-41d0-9488-93088de5933c {{(pid=116083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:20:34.787860 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-54612b1e-4b7f-4d2f-9974-4438eae38ab0 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c/os-volume_attachments/4e4de79d-5236-4a54-8791-9ac04d974af6" status: 202 len: 0 microversion: 2.1 time: 0.156888 Dec 15 16:20:34.788504 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 574/1229] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Dec 15 16:20:34 2021] DELETE /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c/os-volume_attachments/4e4de79d-5236-4a54-8791-9ac04d974af6 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:20:35.894889 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:35.895451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:35.901535 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:35.901982 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:35.902783 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:35.903212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:35.928112 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:20:35.999936 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5c9fee43-3d2e-42ed-ac1a-a09e76c95b5b tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 204 len: 0 microversion: 2.1 time: 0.109082 Dec 15 16:20:36.000523 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 656/1230] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:20:35 2021] DELETE /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:20:36.009548 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:36.010313 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:36.016646 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:36.017059 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:36.017943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:36.018367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:36.150210 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:36.157964 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-73fb7b56-9bb3-49a2-ba9c-9d0e06450f9c tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1514 microversion: 2.1 time: 0.152921 Dec 15 16:20:36.158532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 575/1231] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:36 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:37.176876 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:37.177628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:37.183831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:37.184275 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:37.185050 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:37.185510 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:37.343428 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:37.353504 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eac7bcd5-3fec-493c-998a-6529b7056515 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1514 microversion: 2.1 time: 0.180705 Dec 15 16:20:37.354100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 657/1232] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:37 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:38.353923 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-40f2def9-cd85-4f9a-8fca-d02baf6a4d9d req-0e687185-26a2-4bf2-bd8c-832a95e1a2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8e2877-23a1-41d0-9488-93088de5933c", "name": "network-vif-deleted", "tag": "44658c8a-c07f-4ee6-a771-2e1bc32f5a73"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:38.355597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:20:38.355597 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:20:38.363887 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-40f2def9-cd85-4f9a-8fca-d02baf6a4d9d req-0e687185-26a2-4bf2-bd8c-832a95e1a2b7 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:38.364358 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-40f2def9-cd85-4f9a-8fca-d02baf6a4d9d req-0e687185-26a2-4bf2-bd8c-832a95e1a2b7 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:38.372870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:38.373669 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:38.378801 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-40f2def9-cd85-4f9a-8fca-d02baf6a4d9d req-0e687185-26a2-4bf2-bd8c-832a95e1a2b7 service nova] Creating event network-vif-deleted:44658c8a-c07f-4ee6-a771-2e1bc32f5a73 for instance db8e2877-23a1-41d0-9488-93088de5933c on hv-cinder-80070 Dec 15 16:20:38.383557 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:38.383966 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-40f2def9-cd85-4f9a-8fca-d02baf6a4d9d req-0e687185-26a2-4bf2-bd8c-832a95e1a2b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033841 Dec 15 16:20:38.384106 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:38.384574 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 576/1233] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:20:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:38.384991 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:38.386729 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:38.458618 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfb43739519b44368e274c788031766b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15dc48faa0c423e9cfb7e34facc959b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:38.467013 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-95d913ab-c00d-439f-97d2-8b38958dc593 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 200 len: 1304 microversion: 2.1 time: 0.098879 Dec 15 16:20:38.467910 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 658/1234] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:38 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:38.676102 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:20:38.676453 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:20:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:20:39.488640 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:39.489315 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] [instance: db8e2877-23a1-41d0-9488-93088de5933c] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:39.495436 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:39.495879 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:39.496645 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:39.497074 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:39.510164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] HTTP exception thrown: Instance db8e2877-23a1-41d0-9488-93088de5933c could not be found. Dec 15 16:20:39.510742 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] Returning 404 to user: Instance db8e2877-23a1-41d0-9488-93088de5933c could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:20:39.511551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-9666e1d9-1008-40e6-9f69-9ab9cd2f9542 tempest-VolumesSnapshotTestJSON-326723768 tempest-VolumesSnapshotTestJSON-326723768-project] 10.222.0.36 "GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c" status: 404 len: 111 microversion: 2.1 time: 0.028227 Dec 15 16:20:39.512070 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 577/1235] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:39 2021] GET /compute/v2.1/servers/db8e2877-23a1-41d0-9488-93088de5933c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:20:41.978873 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:20:41.979451 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:20:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:20:45.634546 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:20:45.635111 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:20:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:22:07.442173 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1696008997", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-668839965", "security_groups": [{"name": "tempest-secgroup-smoke-1366060423"}], "block_device_mapping_v2": [{"uuid": "385f0c4b-81f8-412a-99b3-4f1b1de8a85e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6bf17fcc-7520-487a-8b2c-b8aaa08a20f8"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:07.701713 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] validate_networks() for [('6bf17fcc-7520-487a-8b2c-b8aaa08a20f8', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:22:08.073703 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:22:08.074169 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:22:08.074641 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:22:08.075046 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:22:08.075490 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:22:08.084579 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.085026 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.085870 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.086300 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.102768 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for project d37336bbfbab45f79ed53d56efe617c4. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:08.106744 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Getting quotas for user 0c89b280c0864631a57aab8564633443 and project d37336bbfbab45f79ed53d56efe617c4. Resources: {'instances', 'cores', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:08.162471 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:22:08.164596 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='385f0c4b-81f8-412a-99b3-4f1b1de8a85e',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:22:08.289899 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-42f9d054-b943-40f2-b233-26452eff166f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.852209 Dec 15 16:22:08.290546 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 659/1236] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Dec 15 16:22:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:22:08.301845 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-01b8a2bc-5ed2-4a06-99cf-b116b83754eb tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:08.302498 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-01b8a2bc-5ed2-4a06-99cf-b116b83754eb tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.424672 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-01b8a2bc-5ed2-4a06-99cf-b116b83754eb tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:08.432880 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-01b8a2bc-5ed2-4a06-99cf-b116b83754eb tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1094 microversion: 2.1 time: 0.136000 Dec 15 16:22:08.433462 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 578/1237] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:08 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1094 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:09.449857 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:09.450465 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:09.457150 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.457619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.458404 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.460078 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.525100 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:09.532655 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a0813ce-4aa7-4faf-b6ab-ab10592ef9b8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1210 microversion: 2.1 time: 0.087168 Dec 15 16:22:09.533235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 660/1238] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:09 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:10.551519 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.552135 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.558772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.559144 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.559944 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.560392 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.771599 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:10.778849 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-221effef-7fb8-4a06-8461-64610e6c589f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.231809 Dec 15 16:22:10.779351 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 579/1239] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:10 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:10.909348 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-ed4db680-b0e2-427e-a12c-8efb88a92b1e req-f3caecf4-5565-4469-a685-e1a518c7aabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e76ae3-5f80-4d68-9e98-21321cb3777f", "tag": "682a098b-3dbc-4134-9c32-8d8da057e616"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:10.911119 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:10.911119 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:10.918620 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ed4db680-b0e2-427e-a12c-8efb88a92b1e req-f3caecf4-5565-4469-a685-e1a518c7aabf service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.919063 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ed4db680-b0e2-427e-a12c-8efb88a92b1e req-f3caecf4-5565-4469-a685-e1a518c7aabf service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.930997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-ed4db680-b0e2-427e-a12c-8efb88a92b1e req-f3caecf4-5565-4469-a685-e1a518c7aabf service nova] Creating event network-changed:682a098b-3dbc-4134-9c32-8d8da057e616 for instance 26e76ae3-5f80-4d68-9e98-21321cb3777f on hv-cinder-80070 Dec 15 16:22:10.937353 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-ed4db680-b0e2-427e-a12c-8efb88a92b1e req-f3caecf4-5565-4469-a685-e1a518c7aabf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122378 Dec 15 16:22:10.937992 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 661/1240] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:11.795820 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:11.796434 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.803233 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.803715 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.804557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.804979 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.971110 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:11.978617 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a618a1dd-a5fb-472b-8a45-0636a2c0e8c0 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.186448 Dec 15 16:22:11.979186 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 580/1241] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:11 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:13.047371 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:13.048068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:13.054785 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.055235 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.056019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.056453 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.203120 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:13.210798 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-56943401-0f7d-491b-a5c6-5fd671d29f05 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.218933 Dec 15 16:22:13.211363 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 662/1242] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:12 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:14.227641 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:14.228248 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:14.235321 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.235769 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.236557 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.236990 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.385619 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:14.392837 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-89ba8b19-0bfb-417c-a4eb-8ccfea415769 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.169456 Dec 15 16:22:14.393409 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 581/1243] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:14 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:15.413042 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:15.414105 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:15.422062 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.422505 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.423278 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.423706 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.553320 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:15.560619 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ea6f3ff4-e482-4d94-9945-c8f04e257588 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.154172 Dec 15 16:22:15.561201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 663/1244] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:15 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:16.578698 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:16.579338 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:16.585822 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.586271 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.587041 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.587474 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.728242 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:16.735454 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-a8d3a0e5-d908-4eff-8d6c-aab2c951b5ca tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.160406 Dec 15 16:22:16.736018 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 582/1245] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:16 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:17.752123 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:17.752722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:17.759628 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.760068 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.760831 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.761258 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.891455 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:17.898943 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34d346b7-4a80-4e4a-8af4-48fa0e4944a4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.150465 Dec 15 16:22:17.899521 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 664/1246] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:17 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:18.916316 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:18.916929 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.923158 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.923625 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.924386 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.924816 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:19.068799 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:19.076380 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-df310d72-163c-42bc-8cdb-bdf1157ff13b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.164403 Dec 15 16:22:19.076950 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 583/1247] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:18 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:20.093711 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:20.094313 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.101008 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.101539 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.102319 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.102779 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.234147 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:20.242152 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-817b8a60-3b5c-407e-b3c0-363cd0c485ff tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.152128 Dec 15 16:22:20.242722 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 665/1248] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:20 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:21.114278 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [req-82f996ae-9549-48f4-a136-8e0da038a2a0 req-1191b912-2590-4098-b03d-9ace53fbce80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e76ae3-5f80-4d68-9e98-21321cb3777f", "name": "network-vif-plugged", "status": "completed", "tag": "682a098b-3dbc-4134-9c32-8d8da057e616"}]} {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:21.116046 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:21.116046 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: warnings.warn(msg) Dec 15 16:22:21.122997 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-82f996ae-9549-48f4-a136-8e0da038a2a0 req-1191b912-2590-4098-b03d-9ace53fbce80 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.123440 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [req-82f996ae-9549-48f4-a136-8e0da038a2a0 req-1191b912-2590-4098-b03d-9ace53fbce80 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.134533 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.compute.server_external_events [req-82f996ae-9549-48f4-a136-8e0da038a2a0 req-1191b912-2590-4098-b03d-9ace53fbce80 service nova] Creating event network-vif-plugged:682a098b-3dbc-4134-9c32-8d8da057e616 for instance 26e76ae3-5f80-4d68-9e98-21321cb3777f on hv-cinder-80070 Dec 15 16:22:21.139487 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [req-82f996ae-9549-48f4-a136-8e0da038a2a0 req-1191b912-2590-4098-b03d-9ace53fbce80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089083 Dec 15 16:22:21.140048 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 584/1249] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:21.259591 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:21.260143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:21.266447 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.266898 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.267683 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.268118 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.418571 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:21.426136 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-85df3388-5d20-497c-be71-c009d6341255 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.170786 Dec 15 16:22:21.426712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 666/1250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:21 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:22.443860 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:22.444550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:22.450782 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:22.451227 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:22.452007 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:22.452442 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:22.589940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:22.597352 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d070b85b-45c6-42e1-ae6f-adef7113b65f tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1266 microversion: 2.1 time: 0.158464 Dec 15 16:22:22.598010 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 585/1251] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:22 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:23.614398 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:23.614997 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.621257 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.621742 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.622522 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.622958 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.756143 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:23.763622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2eece8ad-e25a-4299-b1fb-13a7509a5386 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1454 microversion: 2.1 time: 0.153057 Dec 15 16:22:23.764188 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 667/1252] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:23 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:23.780273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:23.780873 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.786943 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.787921 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.788680 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.789105 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.918549 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:23.925931 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-56fa2a8d-718e-4001-ba95-f35eba0f4f93 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1454 microversion: 2.1 time: 0.148916 Dec 15 16:22:23.926485 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 586/1253] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:23 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:25.900173 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1f5f0e9b-fa1f-45c7-bc1e-c010febd4f5c req-c1bdbd7a-6c13-4549-9ff3-b2f1ff17af7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e76ae3-5f80-4d68-9e98-21321cb3777f", "tag": "682a098b-3dbc-4134-9c32-8d8da057e616"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:25.901781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:25.901781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:25.909019 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1f5f0e9b-fa1f-45c7-bc1e-c010febd4f5c req-c1bdbd7a-6c13-4549-9ff3-b2f1ff17af7c service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.909483 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1f5f0e9b-fa1f-45c7-bc1e-c010febd4f5c req-c1bdbd7a-6c13-4549-9ff3-b2f1ff17af7c service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.920503 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1f5f0e9b-fa1f-45c7-bc1e-c010febd4f5c req-c1bdbd7a-6c13-4549-9ff3-b2f1ff17af7c service nova] Creating event network-changed:682a098b-3dbc-4134-9c32-8d8da057e616 for instance 26e76ae3-5f80-4d68-9e98-21321cb3777f on hv-cinder-80070 Dec 15 16:22:25.926358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1f5f0e9b-fa1f-45c7-bc1e-c010febd4f5c req-c1bdbd7a-6c13-4549-9ff3-b2f1ff17af7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029281 Dec 15 16:22:25.926958 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 668/1254] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:58.694895 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:23:58.695538 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:23:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:24:01.996703 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:24:01.997358 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:24:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:24:05.651897 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:24:05.652438 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:24:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:24:05.760611 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.761155 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.766151 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-09a4c31c-03e3-46da-998b-b26e3b3c7d36 req-8496fa2a-0ffe-46be-9239-921e0595e539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e76ae3-5f80-4d68-9e98-21321cb3777f", "tag": "682a098b-3dbc-4134-9c32-8d8da057e616"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:05.767288 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.767633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:05.767633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:05.767838 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.768498 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.769060 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.774792 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-09a4c31c-03e3-46da-998b-b26e3b3c7d36 req-8496fa2a-0ffe-46be-9239-921e0595e539 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.775232 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-09a4c31c-03e3-46da-998b-b26e3b3c7d36 req-8496fa2a-0ffe-46be-9239-921e0595e539 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.786363 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-09a4c31c-03e3-46da-998b-b26e3b3c7d36 req-8496fa2a-0ffe-46be-9239-921e0595e539 service nova] Creating event network-changed:682a098b-3dbc-4134-9c32-8d8da057e616 for instance 26e76ae3-5f80-4d68-9e98-21321cb3777f on hv-cinder-80070 Dec 15 16:24:05.792285 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-09a4c31c-03e3-46da-998b-b26e3b3c7d36 req-8496fa2a-0ffe-46be-9239-921e0595e539 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036885 Dec 15 16:24:05.792874 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 669/1255] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:05.797847 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:05.882244 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ad16567b-0615-4348-836d-8ee4e33c4b72 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "DELETE /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 204 len: 0 microversion: 2.1 time: 0.128875 Dec 15 16:24:05.883072 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 587/1256] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:05 2021] DELETE /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:05.892649 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.894434 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.902405 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.903156 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.904633 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.905241 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.054030 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.062366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-982e2170-15c4-4988-86c6-fe24ac47143b tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1578 microversion: 2.1 time: 0.174698 Dec 15 16:24:06.063164 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 670/1257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:07.080890 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.081624 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.089322 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.089850 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.090635 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.091114 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.221834 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.229174 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-ff4709d0-28fa-4802-8bb5-5f2223decc30 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1460 microversion: 2.1 time: 0.152349 Dec 15 16:24:07.229765 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 588/1258] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:08.229461 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-d77b9016-2a65-4266-b704-bef24ece7c2d req-f7a98d49-bb24-4788-bbe7-b281ab45c9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e76ae3-5f80-4d68-9e98-21321cb3777f", "name": "network-vif-deleted", "tag": "682a098b-3dbc-4134-9c32-8d8da057e616"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:08.230984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:08.230984 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:08.238561 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-d77b9016-2a65-4266-b704-bef24ece7c2d req-f7a98d49-bb24-4788-bbe7-b281ab45c9ce service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.239006 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-d77b9016-2a65-4266-b704-bef24ece7c2d req-f7a98d49-bb24-4788-bbe7-b281ab45c9ce service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.247054 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:08.247846 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:08.252201 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-d77b9016-2a65-4266-b704-bef24ece7c2d req-f7a98d49-bb24-4788-bbe7-b281ab45c9ce service nova] Creating event network-vif-deleted:682a098b-3dbc-4134-9c32-8d8da057e616 for instance 26e76ae3-5f80-4d68-9e98-21321cb3777f on hv-cinder-80070 Dec 15 16:24:08.255109 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.257723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.258255 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-d77b9016-2a65-4266-b704-bef24ece7c2d req-f7a98d49-bb24-4788-bbe7-b281ab45c9ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Dec 15 16:24:08.258529 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.258882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 671/1259] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:08.259239 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.326068 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.333509 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-76061226-4c65-45cc-95b7-82661d9788fd tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 200 len: 1225 microversion: 2.1 time: 0.090317 Dec 15 16:24:08.334754 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 589/1260] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:08 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:09.352086 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.352781 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 26e76ae3-5f80-4d68-9e98-21321cb3777f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.361719 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.362169 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.363282 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.364057 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.377366 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] HTTP exception thrown: Instance 26e76ae3-5f80-4d68-9e98-21321cb3777f could not be found. Dec 15 16:24:09.377967 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Returning 404 to user: Instance 26e76ae3-5f80-4d68-9e98-21321cb3777f could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:09.378819 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d596cb4-392c-496d-8ba4-1f2b95f8a8e5 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f" status: 404 len: 111 microversion: 2.1 time: 0.031500 Dec 15 16:24:09.379349 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 672/1261] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/26e76ae3-5f80-4d68-9e98-21321cb3777f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:12.414954 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:12.415473 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:12.418160 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-04c65f04-a9aa-4ddb-abbe-167ca710e509 req-13a0aa75-1ebe-434c-b77d-2908110a8f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819b4a9c-2da2-40d7-917d-bb9475f1874a", "tag": "764c6fb7-9c23-438e-a0c8-71a2e0c0ef74"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:12.420056 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:12.420056 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:12.421772 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.422218 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.423221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.423651 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.428389 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-04c65f04-a9aa-4ddb-abbe-167ca710e509 req-13a0aa75-1ebe-434c-b77d-2908110a8f8f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.428898 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-04c65f04-a9aa-4ddb-abbe-167ca710e509 req-13a0aa75-1ebe-434c-b77d-2908110a8f8f service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.440622 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-04c65f04-a9aa-4ddb-abbe-167ca710e509 req-13a0aa75-1ebe-434c-b77d-2908110a8f8f service nova] Creating event network-changed:764c6fb7-9c23-438e-a0c8-71a2e0c0ef74 for instance 819b4a9c-2da2-40d7-917d-bb9475f1874a on hv-cinder-80070 Dec 15 16:24:12.446113 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-04c65f04-a9aa-4ddb-abbe-167ca710e509 req-13a0aa75-1ebe-434c-b77d-2908110a8f8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Dec 15 16:24:12.446712 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 673/1262] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:12.451399 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Going to try to terminate instance {{(pid=116083) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:12.532643 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-d45de2c4-895c-477e-ae75-5c0e4736b082 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "DELETE /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 204 len: 0 microversion: 2.1 time: 0.121656 Dec 15 16:24:12.533975 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 590/1263] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:12 2021] DELETE /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:12.543220 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:12.544212 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:12.550697 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.551217 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.552480 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.553119 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.708865 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.716508 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a8b73a23-4798-4f09-bfb0-5eef59d07885 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1576 microversion: 2.1 time: 0.177240 Dec 15 16:24:12.717372 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 674/1264] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:12 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:13.734808 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.735429 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.742273 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.742723 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.743497 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.743932 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.891152 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.898823 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-076a046c-44d6-4ed2-ae9f-13a035974ec8 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1458 microversion: 2.1 time: 0.168141 Dec 15 16:24:13.899390 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 591/1265] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:13 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:14.815287 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-b284dd9a-cb96-4ab7-9bf2-9a8f2e4d325a req-ba5c85c1-f587-4bba-af3a-3ea498a006a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819b4a9c-2da2-40d7-917d-bb9475f1874a", "name": "network-vif-deleted", "tag": "764c6fb7-9c23-438e-a0c8-71a2e0c0ef74"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:14.816855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:14.816855 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:14.824913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b284dd9a-cb96-4ab7-9bf2-9a8f2e4d325a req-ba5c85c1-f587-4bba-af3a-3ea498a006a5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.825357 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b284dd9a-cb96-4ab7-9bf2-9a8f2e4d325a req-ba5c85c1-f587-4bba-af3a-3ea498a006a5 service nova] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.836771 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-b284dd9a-cb96-4ab7-9bf2-9a8f2e4d325a req-ba5c85c1-f587-4bba-af3a-3ea498a006a5 service nova] Creating event network-vif-deleted:764c6fb7-9c23-438e-a0c8-71a2e0c0ef74 for instance 819b4a9c-2da2-40d7-917d-bb9475f1874a on hv-cinder-80070 Dec 15 16:24:14.841782 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-b284dd9a-cb96-4ab7-9bf2-9a8f2e4d325a req-ba5c85c1-f587-4bba-af3a-3ea498a006a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030145 Dec 15 16:24:14.842381 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 675/1266] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:14.915551 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.916164 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.922532 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.922976 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.923752 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.924308 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.991325 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.policy [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c89b280c0864631a57aab8564633443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37336bbfbab45f79ed53d56efe617c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116083) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.998577 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-18bebf95-10fa-4280-b5c5-eb0a44033123 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 200 len: 1224 microversion: 2.1 time: 0.086779 Dec 15 16:24:14.999221 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 592/1267] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:16.017250 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.017974 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 819b4a9c-2da2-40d7-917d-bb9475f1874a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.024582 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.025033 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.025895 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.026330 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.041069 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] HTTP exception thrown: Instance 819b4a9c-2da2-40d7-917d-bb9475f1874a could not be found. Dec 15 16:24:16.041682 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Returning 404 to user: Instance 819b4a9c-2da2-40d7-917d-bb9475f1874a could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:16.042913 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-99d3ed3f-69e0-4316-a0b9-04bc9942edf7 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a" status: 404 len: 111 microversion: 2.1 time: 0.029886 Dec 15 16:24:16.043041 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 676/1268] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:16 2021] GET /compute/v2.1/servers/819b4a9c-2da2-40d7-917d-bb9475f1874a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:16.733658 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.734163 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.compute.api [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116083) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.741290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.741842 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.742658 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.743038 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG oslo_concurrency.lockutils [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.756367 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.wsgi [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] HTTP exception thrown: Instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 could not be found. Dec 15 16:24:16.756940 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Returning 404 to user: Instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 could not be found. {{(pid=116083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:16.757776 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-1dbc1ab7-bb1f-4678-a071-4bce17f04754 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 404 len: 111 microversion: 2.1 time: 0.028123 Dec 15 16:24:16.758290 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 593/1269] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:16 2021] DELETE /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:16.766085 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.766687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] [instance: 6a17033c-80a1-4a18-add4-7d228b7ea5e9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.772458 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.772900 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.773687 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.774115 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Lock "309b8a82-e599-4304-b992-62cc90d7ef9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.786730 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] HTTP exception thrown: Instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 could not be found. Dec 15 16:24:16.787295 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Returning 404 to user: Instance 6a17033c-80a1-4a18-add4-7d228b7ea5e9 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:16.788095 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8b54a5dd-20dd-4136-bfe3-05bbe8134db2 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9" status: 404 len: 111 microversion: 2.1 time: 0.025690 Dec 15 16:24:16.788604 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 677/1270] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:16 2021] GET /compute/v2.1/servers/6a17033c-80a1-4a18-add4-7d228b7ea5e9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:18.068306 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: DEBUG nova.api.openstack.wsgi [None req-61d5a887-50ae-4006-a5c2-441dd80dc3e4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] Calling method '.version_select at 0x7f88b8102700>' {{(pid=116083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:18.091574 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO nova.api.openstack.requestlog [None req-61d5a887-50ae-4006-a5c2-441dd80dc3e4 tempest-TestVolumeBootPattern-867278572 tempest-TestVolumeBootPattern-867278572-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-668839965" status: 202 len: 0 microversion: 2.1 time: 0.027534 Dec 15 16:24:18.092369 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: [pid: 116083|app: 0|req: 594/1271] 10.222.0.36 () {58 vars in 1259 bytes} [Wed Dec 15 16:24:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-668839965 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:27:18.430866 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:27:18.431455 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:27:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:27:18.712614 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:27:18.713160 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:27:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:27:22.014882 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:27:22.015443 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:27:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:27:25.670559 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:27:25.671096 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:27:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:29:16.583853 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:29:16.584550 dv-cinder-800704-2-iscsi devstack@n-api.service[116083]: Wed Dec 15 16:29:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:29:20.165085 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:29:20.165650 dv-cinder-800704-2-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:29:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!